Eo a o 


JOURNAL OF 23 
CONSULTING SPSYCHOLOGY — 


Edited By ie ve 
Edward S. Bordin *. , å 
University of Michigan E 7 y. 
Advisory Editors 
John W. Atkinson Ruth L. Munroe 
University of Michigan New York, N. Y. 
John M. Butler Anne Roe 


University of Chicago New York University 


Saul Rosenzweig 
Washington University 


Julian B. Rotter 
Ohio State University 
Robert B. Malmo b- Nevit Sanford 3 

McGill University niversity of California 


Seymour Fisher 
Baylor University 


Harison G. Gough 


University of California 


Seymour B. Sarason 
Boyd R. McCandless Yale University 


University of Iowa 
Robert R. Sears 


ul E. Mi 
Ea j eeb] Stanjord University 
University of Minnesota 
: $ Edwin S. Shneidman 
Daniel R. Miller Veterans Administration, 
University of Michigan Los Angeles, California 


Read D. Tuddenham 


University of California 


VOLUME 23 
t939 


Arthur C. Hoffman, Managing Editor; Helen Orr, Promotion Manager; 
Barbara Cummings, Editorial Assistant 


Published Bimonthly By 


The American Psychological Association, Inc. 
1333 Sixteenth St, N.W. 
Washington 6, D. C. 


Printed at a g j 50 


Lancaster, Pennsylvania 


Copyright © 1959 by the American Psychological Association, Inc. 


fasearch 


“he aah 


a Aea eel 


Bureau of f 
i He he, Be es 


Contents of Volume 23 


Adams, Abby B. Choice of Infant Feeding Technique as a Function of Maternal Personality 

Affleck, D. C., and Mednick, S. A. The Use of the Rorschach Test in the Prediction of the 
Abrupt Terminator in Individual Psychotherapy - - - - - - - - - - - - 

Akel, M. See Estes, Betsy W. Š 

Allison, J., and Hunt, D. E. Social Desirability and the Expression of Aggression under 

Varying Conditions of Frustration - - - - - - - - - - - = = - > > > 

_ Anderson, A. C. See Peterson, D. R. 

Angelino, H. See Nebergall, Nelda S. 

Astin, A. W. A Factor Study of the MMPI Psychopathic Deviate Scale - - - - - - 

Baron, M. R. See Hoyt, T. E. 

Bauer, R. W. See Johnson, D. E. 

Becker, W.C., Peterson, D. R., Hellmer, L. A., Shoemaker, D. J., and Quay, H. C. Factorsi 


Bendig, A. W. Score Reliability of Dichotomous and Trichotomous Item Respoases on the 
Maudsley Personality Inventory- - - - - - - - <- =- =- -ê =-=- =F 

Bendig, A. W. “Social Desirability” and “Anxiety” Variables in the IPAT Anxiety Scale 

Beier, E. G., and Stumpf, J. Cues Influencing Judgment of Personality Characteristics - 

Bernstein, L. See Pile, E. 

Bills, R. E. Two Questions: A Reply to Cowen and Tongas - - - - - - - - - - 

Bindman, A. J. Mental Health Consultation: Theory and Practice- - - - - - - - 

Bloom, B. L. Ecologic Factors in the WAIS Picture Completion test - - - - - - - 

E T A ROIR O ei a a we RE ee 

ostian, D. W. See Lasky, J. J. ; 

ridges, C. Nomographs for Computing the “Validity” of WISC or Wechsler-Bellevue 
Short Forms: <= 9532) ec) sees: each = Sse ss =) See 

Brown, D. R. See Johnson, D. E. 

Buss, A. H. The Effect of Item Style on Social Desirability and Frequency of Endorsement 

Cadils, S. B. Effect of a Training School Experience on the Personality of Delinquent Boys 

Calden, G., Lundy, R. M., and Schlafer, R. J. Sex Differences in Body Concepts- - - - 

Cameron, G. R. See Peterson, D. R. 

Campbell, D. T. See Chapman, T; di P 

Capell, M. D., and Wohl, J. An Approach to the Factor Structure of Clinical Judgments 


Cattell, R. B. See Peterson, D. R. i 
Chapman, L. J., and Campbell, D. T. Absence of Acquiescence Response Set in the Taylor 


Manifest Anxiety Scale- - - - = 7 7 aee e 
Chapman, L. J., and Pathman, J. H. Errors in the Diagnosis of Mental Deficiency in 


nd EEG Abnor- 


iSchizophrenia'= «= = = =% = = SS eS ss 
Chorost, S. B., Spivack, G., and Levine, M. Bender-Gestalt Rotations ar 
malities intGhildrensg = S| = EnA E E S o Re oa o e a EE 
Clayton, W. H. See Ellsworth, R. B. 
Cohen, J. The Factorial Structure of the WISC at Ages 7-6, 10-6, and 13-6- - - - - 
A, S. See Kassebaum, G. G. 


Couch a 
; d Payne, D. Validation of Doppelt’s WAIS Short Form with a Clinical 


Clayton, H., an 
Population- - ~- 


Cowan L., and Goldman, eo 2 
and the Effect of this Training on Vocational Success- - - - - J 


Cowen, E. L., and Tongas, P. N. The Social Desirability of Trait Descriptive Terms: Appli- 
one to A Seli Concept Menta s = e i eee ik 
iii 


M. The Selection of the Mentally Deficient for Vocational Training 


Parental Behavior and Personality as Related to Problem Behavior in Children, ae 


DeSoto, C. B., and Kuethe, J. L. The Set to Claim Und 

Inventories= = = = fe > BS Se is 

k, S. C. See Lasky, J. J. i E Moa 

a L., Wright, C. E., and Lunneborg, C. E. A Note on ‘Social Desirability as a 
Vatiable in the Edwards Personal Preference Schedule” ~~ 


Eichman, W. J. Discrimination of Female Schizophrenics with Configural Analysis of the 
MMPI Profile- - = = ---. - 


Ellen, P. See Maier, N. R. F. ; ; 
Ellis, A. Requisite Conditions for Basic Personality Change - <= 
Ellsworth, R. B., and Clayton, W. H. Measurement of Improvement in “Mental Illness” - 


Estes, Betsy W., Kodman, F., and Akel, M. The Validity of the Columbia Mental Maturity 
Sealé- a = = a TE p eoa 


Fairweather, G. W. See Lindemann, J. E, 
Fisher, J. The Twisted Pear and the Prediction of Behavior - 
Fisher, S. Body Reactivity Gradients and Figure Dr 
Fiske, D. W., and VanBuskirk, C. The Stability 
ee es 
Friedman, J. Weight Problems and Psychological Factors - ot eae a 
Garfield, S. L., and Sineps, J. An Appraisal of Taulbee and Sisson’s “Configurational 
Analysis of MMPT Profiles of Psychiatric Groups? i. ee o 
Gieseking, C. F, See Williams, aL. 
Ginott, H.C. The Theory and Practice of « 
Glickstein, M. A Note on Wittenborn’s Fac 


esirable Symptoms in Personality 


awing Variables - 4 
of Interpretations of Sentence Completion 


Therapeutic Intervention” in Child Treatment 


$ : tor Analysis of Rorschach Scoring Categories - 

Goldberg, L, R. The Effectiveness of Clinicians? Judgments: The Diagnosis of Organic Brain 
. Damage from the Bender-Gestalt Test- ~ SR a ak ee ye 

Goldman, M. See Cowan, L. 

Jr. The Relationship between Personal and Social 

dwards Personal Preference Schedule- - - - - 

7 z ly, R. M. GSRs during Repression, Suppression, and 

n Psychotherapeutic Interviews - 

ationships among Mothers’ 


S Performance - - - - - ~ 


een Recalled Forms of Childhood Discipline and 

P ipi obs ology - Se ee RES eo wy 
riffith, A. V., and Peym D. A Bye-Ear F asis i 

sisene YD A.R Bye Ear Emphasis in the = 

oe 7 p oe of V ; d Nonverbal Reinforcement jn the Rorsc 

a A MMPI LIER R lationships with Criteria 


as Indicating Ideas 


hach - - - - 
of Behavioral Disturbance and 


alit Test Items - Bt > gee sna 250 aie ohn dk 
tors in Psycho é y 


ts’ Perception of their Patients - - - - 
i omparison of Profiles on the “Circle?” - - - 
a Tmmediate Memory Modification of the Block Design Task: 


maged and Contro] Subjects ~~ 3 F 
ced Scali 


Helin ae Gait ee ng Technique for the Adjective Check List 
ezer, F. A Note on the Postural S y Dist 

Hiler, E. W., The Sen, ion ‘Tea tion ~ 

bree, me Sentence Completi n Test 


oe asa Predictor of Continuation i 
Hellmer, L, A. See Becker, Wy, G oe ee 


n Psycho- 


iv 


496 


<i 
I 


Hover, G. L. See Lasky, J. J. 

Hovey, H. B., Kooi, K. A., and Thomas, M. H. MMPI Profiles of Epileptics- - - - - 

Howard, W. Validities of WAIS Short Forms in a Psychiatric Population- = = = « = 

Hoyt, T. E., and Baron, M. R. Anxiety Indices in Same-Sex Drawings of Psychiatric 
Patients with High and Low MAS Scores- - - - - - - - - 2 2 22 

Hozier, Ann. On the Breakdown of the Sense of Reality: A Study of Spatial Perception in 
Schizophiteiiee <= 8 Wee is eG ee Se ae yt oe epee eee 

Hunt, D. E. See Allison, J. 

Izard, C. E. Paranoid Schizophrenic and Normal Subjects’ Perceptions of Photographs of 
Human aesa S e = a moe ee kee a Ree oe eee 

Jensen, A. R. A Statistical Note on Racial Differences in the Progressive Matrices- - - 

Johnson, D. E., Bauer, R. W., and Brown, D. R. Visual Afterphenomena in Diagnosis - - 

Kagan, J. The Stability of TAT Fantasy and Stimulus Ambiguity = = se = deg 

Kassebaum, G. G., Couch, A. S., and Slater, P. E. The Factorial Dimensions of the MMPI 

Katzenmeyer, W. G. See Spielberger, C. D. 

Kausler, D. H. See Trapp, E. P. 

Klett, C. J., and Lasky, J. J. Agreement among Raters on the Multidimensional Scale for 
Rating Psychiatric Patients - - - - - - - 4 20 2.2... 

Kodman, F. See Estes, Betsy W. 

Kooi, K. A, See Hovey, H. B. 

Kuethe, J. L. See DeSoto, C. B. 

Lasky, J. J., Hover, G. L. Smith, P. A., Bostian, D. W., Duffendack, S. C., and Nord, C. L. 
Post-Hospital Adjustment as Predicted by Psychiatric Patients and by their Staff - 

Lasky, J. J. See Klett, C. J. 

Lawton, M. P. The Screening Value of the Cornell Medical Index - - - . . . . 2 

Lesser, G. S. Population Differences in Construct Vadiye = = s s 2 4 = wn me 

Levin, M. L. A Comparison of the Effects of Phenobarbital, Promethazine, Chlorpromazine, 
and Placebo Upon Mental Hospital Patients- - - <- < 2 2 2 Coie 

Levin, M. L. A Reply to Sines’ Note on a Comparison of the Effects of Phenobarbital 
Promethazine, Chlorpromazine, and Placebo upon Mental Hospital Patients - - - 

Levine, M., Spivack, G., and Wight, B. The Inhibition Process, Rorschach Human Move- 
ment Responses, and Intelligence: Some Further Data - - - 2 . . . 

Levine, M. See Chorost, S. B. 

Levine, M. See Spivack, G. i 

Lighthall, F., Ruebush, B., Sarason, S., and Zweilbelson, T. Change in Mental Ability as a 
Function of Test Anxiety and Type of Mental Test RR ie - = @ we ey ae 

Lindemann, J. E., Fairweather, G. W., Stone, G. B., Smith, R. S., and London, I. T. The Use 
of Demographic Characteristics in Predicting Length of Neuropsychiatric Hospital 
PE = we ee wc nn RHEE SK ee we A Cs se 

Horan 5. MMPI Differences between Parents of Disturbed and Nondisturbed Children 

London, I. T. See Lindemann, J. E. 

Lubin, A. See Rioch, Margaret J. 

Lubin, A. See Williams, H. L. 

Lundy, R. M. See Calden, G. 

Lundy, R. M. See Gordin, J. E. 

Lunneborg, C. E. See Edwards, A. L. 

MacBrayer, Caroline T. Symbolism Validity and Learning without Awareness - - - - 
McDavid, J., Jr. Some Relationships between Social Reinforcement and Scholastic Achieve- 
ment- - - - - - - ~ 
McGowan, J. F. See Schmidt, L. D. ` 
Madoff, J. M. The Attitudes of Mothers of Juvenile Delinquents toward Child Rearing - 
Maier, N. R. F., and Ellen, P. The Integrative Value of Concepts in Frustration Theory 


=F, . a. 


v 


281 


nn, J.H. a x 
tee ane eee H. Insight as a Measure of Adjustment in Three Kinds of 
RCC ie ee ee a SS oa ig 8 
Mere o among Direct and Indirect Measures of the Achievement 
Motive and Overt Behavior - - - - -2 _ | 
Martin, B. The Validity of a Self-Report Measure of Anx 
Interval Covered by the Instructions - - - - 
Martin, B. See Gordon, J. E. 
Masling, J. The Effects of Warm and Cold Interaction on the 
of an Intelligence Test - - - _ _ 
Mednick, S. A. See Affleck, D. C. 
Mischel, W. See Pile, E. 
Mitchell, Anne C. A New M. 
Moos, R., and Mussen P., 
Functioning - - - Si E ie = ae et e cea go 
Murstein, B. I. Conceptual Model of Projective Techniques Applied to Stimulus Variations 
with Thematic Techniques- - -` _ | SSeS ee a eee 
Maussen, P. See M, oos, R, 


Nebergall, Nelda S., Angelino, H., and Young, H. H, A Validation Study of the Self-Activi ty 
Inventory as a Predictor of Adjustment - - = 


Nichols, R. C. The Effect of Ego Invo 
Results - ~~ HR 

Nord, C. L. See Lasky, J. J. 

Otis, L. S. What Does the Rorschach Z Score Reflect? - 

Pathman, J. H. See Chapman, L. J. 

Payne, D. See Clayton, H, 

Peterson, D, R Cattell, R, B., and Quay, H. C, Pers 
Children as Derived from Teacher Ratings - - - 

Peterson, DAR; Quay, H, C., and Anderson, A. C. Extending 
Socialized Scale e es ° 

Peterson, D, R., Quay, H, C. 
Juvenile Delin 


iety as a Function of the Time 


Administration and Scoring 


aximum CA for the Draw-A-Man Test - 
Sexual Symbolism, Perso; 


nality Integration, and Intellectual 


vement and Success Experience on Intelligence Test 


onality Factors in Nursery School 
the Construct Validity of a 


G. R, Personality and Background Factors in 
Questionnaire Responses - - - 


, and Cameron, 

quency as Inferred f 

Peterson, D, R. See Becker, W, C a 
Yman, D.A. RS i 

Philbrick, Emity p. rye eels A. V. 


dity of the Spiral Aftereffect as a Clini 
i See 


í Vali 
7 o Enic Brain Patholo 
ue, E., Mischel i : 1 Re T Figures as an 
free Z fie Bernstein, L. A Note on Remoteness of TAT Figures as an 
Psychological Test Revi - — i 


cal Tool for Diagnosis 


Differential - 


Ontribution to the 
Richey, M, arjorie H, i : 


of Rorschach’s Inkblots via the Semantic 


Sec cy S ene 
d L -A-Man ma Sslationship of Popularity to 

+» and f 3 = ee ee a = = se a 

: A Ee ial Adjustment for Mental Hos; 


Performance on 


pital 


ehh ee Padon Sadia 
| Desirability in the Sentence E — Sanaan 
Ruri, C. See Wiggins, 7. 5 
Ychlak, J. F, F iati 
; Forced Associations, Symbolism, and Rorschach Constructs 


vi 


= ee 
ai teu. Ao DE S AS et O 


vor 


\ 


Sarason, S. See Lighthall, F. 

Saucer, R. T. Chlorpromazine and Apparent Motion Perception by Schizophrenics- - - 

Schein, J. D. Note on a Bibliographical Resource for Studies of Afterimages- - - - - 

Schmidt, L. D., McGowan, J. F. The Differentiation of Human Figure Drawings - - - 

Schonbar, Rosalea A. Some Manifest Characteristics of Recallers and Nonrecallers of 
Diema <= e s S a wemh aa a yy Re ee ee 

Schubert, D. S. P. Personality Implications of Cigarette Smoking among College Students 

Schlafer, R. J. See Calden, G. 

Shippee-Blum, Eva Maria. The Young Rebel: Self-Regard and Ego-Ideal- - - - - - 

Shoemaker, D. J. See Becker, W. C. 

Sines, L. K. A Note on Levin’s Report of Findings with Phenobarbital, Promethazine, 
Chlorpromazine; and Placebo = = s = a m == sew... . ee 

Sines, L. K. The Relative Contribution of Four Kinds of Data to Accuracy in Personality 

SMENGS s S m eala ee! xog g o B ee a 

Sineps, J. See Garfield, S. L. 

Singh, T. R. See Sinka, D. 

Sinha, D., and Singh, T. R. Manifest Anxiety and Performance on Problem Solving Tasks 

Slater, P. E. See Kassebaum, G. 

Smith, E. E. Defensiveness, Insight, and the K Scale - - 2 . 2 a 66. a 

Smith, R. S. See Lindemann, J. E. 

Smith, P. A. See Lasky, J. J. 

Speisman, J. C. Depth of Interpretation and Verbal Resistance in Psychotherapy - - - 

Sperrazzo, G., and Wilkins, W. L. Racial Differences on Progressive Matrices - - - - 

Spielberger, C. D., and Katzenmeyer, W. G. Manifest Anxiety, Intelligence, and College 
CO = Fe we ee le ee 

Spivack, G. See Chorost, S. B. 

Spivack, G. See Levine, M. 

Spolts, J. V. See Richey, Marjorie H. 

Spivack, G., Levine, M., and Sprigle, H. Intelligence Test Performance and the Delay 
arctan of the Bgo- = = = = = mee Ge Se ee y 

Sprigle, H. See Spivack, G. 

Stieper, D. R., and Wiener, D. N. The Problem of Interminability in Outpatient Psycho- 
thetipy= = se e aaaea ane n Maa a ee 

Stone, Beth. Prognostic Factors in Schizophrenia - - - - < a 2. 2 2o 22 4 

Stone, G. B. See Lindemann, J. E. 

Streilfeld, J. W. Expressed Acceptance of Self and Others by Psychotherapists - - - - 

Stumpf, J. See Beier, E. G. 

Taylor, J. B. Social Desirability and MMPI Performance: The Individual Case- - - - 

Thomas, M. H. See Hovey, H. B. 

Tongas, P. N, See Cowen, E. L. ; 

Trapp, E. P., and Kausler, D. H. Association Tendencies of Groups Differentiated on the 
Taylor Manifest Anoe Scale = a E Ss ee a es 5 sc o 

Van Buskirk, C. See Fiske, D. W. 

Wiener, D. N. See Stieper, D. R. 

Wiener, G. The Interaction among Anxiety, Stress Instructions, and Difficulty - - = - 

Wiggins, J. S. Interrelationships among MMPI Measures of Dissimulation under Standard 
and Social Desirability Instructions- = - ~- =- = = = = = m =a aa m 

Wiggins, J. S., and Rumrill, C. Social Desirability in the MMPI and Welsh’s Factor Scales 
Aand RRM e e DE Be ee a a a a 

Wight, B. See Levine, M. 

Wilkins, W. L. See Sperrazzo, G. 


vii 


387 


324 


419 


100 


Williams, H. L., Lubin, A., and Gieseking, 
in Brain-Injured Patients = 3 3 See Se ee eS we es BOO 

Wishner, J. Factor Analysis of Rorschach — Categories and First Response Times in 
Normals - ---- - 

Wiitenborn, J. R. Some eee 

Wohl, J. See Capell, M. D. 

Wright, C. E. See Edwards, A. L. 

Young, H. H. See Nebergall, Nelda S. 


Zuk, G. H. Autistic Distortions in Parents of Retarded Children - 
Zuweilbelson, I. See Lighthall, F. 


C. F. Direct Measurement of Cognitive Deficit 


eS cies © 8k Se ie ee MBG 
s on Confounded Correlations Among 


Rorschach Scores 75 


- - - 171 


a ae 


viii 


February, 1959 Vol. 23, No. 1 
Contents 
EprtortaL: Edward S. Bordin = - = = - = - = - m = = = = m = = amai Si 1 
ARTICLES 
A Conceptual Model of Projective Techniques Applied to Stimulus Variations With 
Thematic Techniques: Bernard I. Murstein- - - - - - ~~ - - - -5 - 3 
Measurement of Improvement in “Mental Illness”: Robert B. Ellsworth and William H. 
Clit. = = = = — See ee Se rm ee He eS N 
A Validation Study of the Self-Activity Inventory as a Predictor of Adjustment: Nelda ` 
S. Nebergall, Henry Angelino, and Harl H. Young- - - - - - - - - - - - 2 
The Effectiveness of Clinicians’ Judgments: The Diagnosis of Organic Brain Damage 
From the Bender-Gestalt Test: Lewis R. Goldberg- - - - - - - - - ~ - - 25 
Change in Mental Ability as a Function of Test Anxiety and Type of Mental Test: 
eee vee tpi Ruebush, Seymour Sarason, and I. bse Zweibelson - Ea : ni 
The Validity of the Spiral Aftereffect as a Clinical Tool for Di i i i 
Pathology: Emy PRB = ie c a a a OreeniciBrain F 
The Young Rebel: Self-Regard and Ego-Ideal: Eva Maria Shippee-Blum - - - - - 44 
An Approach to the Factor Structure of Clinical Judgments: Martin D. Capell and Julian 
Wohl =e es m = œw s = = a = = a aa SS ee eS HR ee 
Body Reactivity Gradients and Figure Drawing Variables: Seymour Fisher - - - - F 
Population Differences in Construct Validity: Gerald S. Lesser- - - - as) 


Effects of Verbal and Nonverbal Reinforcement in the Rorschach: Leonard R. Gross - 66 
A Note on Wittenborn’s Factor Analysis of Rorschach Scoring Categories: Mitchell 

Ghicksteip- = = a eS am a HR ee eee me OO 

Some Comments on Confounded Correlations Among Rorschach Scores: J. R. Wittenborn 15 
The Selection of the Mentally Deficient for Vocational Training and the Effect of This 

Training on Vocational Success: Lawrence Cowan and Morton Goldman- - - - - 78 
The Use of Demographic Characteristics in Predicting Length of Neuropsychiatric 
Hospital Stay: James E. Lindemann, George W. Fairweather, Gideon B. Stone, Robert 

S. Smith, and Ira T..London= = = = = = = = Be n oa = ee m e SOD 


Brizr REPORTS 
Visual Afterphenomena in Diagnosis: Derwood E. Johnson, Robert W. Bauer, and Don 


R. Brown- - - - TRE Seanca FR SS SS Be Se AR 
Insight as a Measure of Adjustment in Three Kinds of Group Experience: John H. 

Mann and Carola Honroth Mann - - - - - - - - - - ------- 9 
The Effect of Ego Involvement and Success Experience on Intelligence Test Results: 

Robert C. Nichols - - - - - - - = - = = = = = = = = = = = = - 92 


me reer 


) 
Bureau Edni, Psy, Research | 


J DAVID Hai Enana nn” 


Brief Reports 


The Journal of Consulting Psychology will 
accept Brief Reports of research studies in 
Clinical psychology for early publication with- 
out expense to the author. The procedure is 
intended to permit the publication of soundly 
designed studies of specialized interest or lim- 
ited importance which cannot n 
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© insure that the Brief R i 
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including all matter except the title and the 
author’s lines, must not exceed 80 lines av- 
eraging 42 characters and spaces in length. 
Set the typewriter margins for short lines of 
42 characters, which are 3.5 inches Jong in 
elite typing, and 4.2 inches long in pica. . 
The manuscript of the Brief Report must 
be double spaced throughout. Except for its 
short lines, it follows the standard style of 
the 1957 revision of the APA Publication 
Manual. Headings, tables, and references are 
avoided or, if essential, must be counted in 
the 80 lines. Each Brief Report must be ac- 
companied by a footnote in the style below, 


which is typed on a separate sheet and not 
counted in the 80-line quota: 2 


*An extended report of this study may be ob 
ined without charge from John Doe, 300 Marke! 
St., Prospect 6, Mass. (giving the author’s full name 
and address), or for a fee from the American Docu- 
mentation Institute, Order Document No, —, Te- 


mitting $—_ for microfilm or $—— for photo- 
copies, 


Extended report. Because the extended re- 
Port is intended for Photoduplication, and is 
not copy to be sent to a printer, its style 
should differ in several ways from that of 
other manuscripts: (a) The extended report 
should be typed with single spacing for 


e 
prepared in the style speci- 
fied by the Publication Manual. a4 
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EDITORIAL 


With this issue, the Journal of Consulting Psy- 
chology has become the responsibility of a new 
Editor, punctuating 12 years of guidance by 
Laurance F. Shaffer. I do not plan to mark this 
occasion by any extended review of that signifi- 
cant period nor by an elaborate statement of a 
prospectus. The retiring Editor plans a report of 
his stewardship, and to him naturally falls the 
responsibilities and well earned satisfactions such 
a review will offer. 

An editor of a well established journal, as this 
one is, finds ‘little scope for radical invention. 
The American Psychological Association, through 
its Publications Board, defines its general sphere 
as “the clinical journal.” As such, its contents 
include original research relevant to psychologi- 
cal diagnosis, psychotherapy and counseling, per- 
sonality, and the dynamics of behavior. Although 
quantitative studies have been given priority, 
relevant theoretical contributions, case studies, 
and descriptions of clinical techniques are also 


acceptable. 
Since readers and authors are a vastly over- 


lapping group, I am using this opportunity of 
catching their attention to emphasize the differ- 
ence between the official definition of the Jour- 
nal’s scope and what is defined by the articles 
that appear between its covers. The primacy of 
original research is easily evident even to the 
casual reader. The retiring Editor, with the help 
of other research minded clinical psychologists, 
has removed any lasting doubt that the subject 
matter of clinical psychology is susceptible to 
thoroughgoing empirical treatment. From here 
on, the image of the journal must be sketched in 
largely imaginary lines. Theoretical contributions 
occur at the rate of slightly more than one a 
year. Case studies and descriptions of clinical 
techniques are virtually unrepresented. 

Why the discrepancy between the official and 
the functioning images? Some may suggest that 
it reflects the Editor’s biases. Experience with my 
first 200 submitted manuscripts makes me doubt 
the validity of that explanation. In that sample, 
there were the usual one or two theoretical con- 
tributions that were worthy enough to be ac- 
cepted for publication. The two case studies of- 
fered were done without clear focus as to their 

_ purpose or with conviction that they could be 
: scholarly contributions. 


I refuse to believe that the potential for a 
more rounded contribution to the literature on 
clinical psychology does not exist. I affirm my 
faith that we will not endanger our newly won 
rigor and empiricism when we give our attention 
and the Journal’s pages to imaginative flights be- 
yond the fully charted regions, to speculative ex- 
cavations that will open up new mines of data, 
and to the vivid presentation of clinical experi- 
ences from which research in clinical psychology, 
above all else, should draw its nourishment. 

There ought to be more evidence of the fer- 
ment in our field. We need reviews that force all 
of us to pause in our mad chase for data to con- 
template what the data at hand have to offer. 
When so many studies of manifest anxiety have 
been completed, it is time for someone to ex- 
amine the question of what we have learned and 
of which are the most profitable new directions 
to pursue. Incidentally, too many manuscripts 
hurry to tell what data have been collected, how 
obtained, and the results of their analysis—be- 
fore taking any trouble to show the reader why 
he should care what answer is forthcoming. I 
have heard the opinion expressed that the Jour- 
nal wants short papers; authors are expected to 
excise all theory. This is not to be our policy. 
Similarly, even this brief experience has made 
me acutely conscious of how much fragmenting 
of research reports exists. Within one volume, or 
distributed over two, a man will publish two or 
more interrelated studies that would best be re- 
ported as one. I shall act on the conviction that 
one well rounded report incorporating a series of 
related studies is worth more than the sum of the 
piecemeal reports of the parts of the series. 

As I write, I find that a fighting mood rises. I 
do think we need some controversy, but without 
rancor. In constructive fashion, we need to re- 
view each other’s work. We sorely need critical 
reviews of specific tests or clinical techniques, or 
of ways of reaching specific types of inferences, 
of interest to the clinician. The data regarding 
many of our most used clinical instruments, es- 
pecially the Rorschach and Minnesota Multi- 
phasic, are so vast and so heterogeneous that 
they defy review as a whole. It seems to me that 
there can be no meaningful answer to the ques- 
tion of whether either instrument is valid. It is 
more meaningful to take a particular type of in- 
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ference that is drawn by use of the instrument, 
examine the logical structure on which it rests, 
and review the data which will show how tenable 
that logical structure is. 

Finally, there is a need for communication and 
mutual stimulation that can lead to the evolution 
of new clinical procedures. We need discussions 
and descriptions on such topics as patterns of 
group practice, intake practices, or.problems of 
supervision—to mention but a few. 

Some may fear that I am inviting rambling, 


indistinctly formed, free associative contributions 
such as might come from a diary of a clinical 
psychologist. This is far from my purpose. The 
Journal of Consulting Psychology will accept 
only those contributions that show evidence that 
the creative spark has been fanned into flame 
through the application of a rigorous scholarship 
which places the contribution in its theoretical 
and historical context. 
Epwarp S, BORDIN 
Editor 
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The clinical psychologist today would hardly 
accept without reservation the view that the 
projective techniques necessarily evoke re- 
sponses tapping the “. . . private world of 
the individual, comprising as it does, the feel- 
ings, urges, beliefs, attitudes, and desires of 
which he may be dimly aware and which he 
is often reluctant to admit even to himself, 
much less to others . . .” (Frank, 1948, p. 
66). Neither would he, in most cases, leap 
to second the view that “The interpretative 
methods [TAT] offer the subject a situation 
or action to which he responds by a creative 
activity, wherein is disclosed his basic con- 
cepts, expectations, feelings” (Frank, 1948, 
p. 57). 

Such views have not sufficiently emphasized 
the importance of the stimulus properties of 
the various techniques as well as such back- 
ground characteristics as examiner-examinee 
relationship in determining the response 
elicited. What is currently needed is a the- 
ory to account for the interaction of the vari- 
ous determinants of responses to projective 
techniques. In this regard, the theory of 
adaptation-level of Helson (1955) seems most 
helpful. The theory briefly stated would hold 
that: 


Operationally the adaptation level is represented 
by the stimulus to which the organism responds, 
either not at all or in an indifferent or neutral man- 
ner. In a large variety of situations the AL proves 
to be a weighted log mean of three classes of stimuli: 
the stimulus in the focus of attention; all stimuli in 
the field forming the context or background; and 
residuals from past experience. These three classes of 
stimuli pool or interact to determine the AL and, 
hence, the adjustment of the organism. As stimula- 
tion or behavior varies, the adaptation level fluctu- 
ates accordingly. A simple formula expresses these 


facts more clearly and concisely as follows: 
log A =p log X +q log B +r log R 


where p, q, and r are weighting factors showing the 
relative importance of X—the stimulus, B—the back- 
ground, and R—the residual (pp. 91-92). 


In adapting this approach to the analysis 
of responses to projective techniques, it may 
be useful to spell out each of the three cate- 
gories in some detail. 


Stimulus Properties of Tests 


Under this heading may be considered the 
varying degrees of ambiguity characteristic of 
the different techniques. Thus, the Draw-A- 
Person has no structure aside from the limita- 
tions ensuing from the instructions to “draw 
a whole person,” and the use of an 8 X 11 
sheet of white paper and a pencil. The Ror- 
schach has a series of blots selected on the 
basis of certain shading, color, and structural 
qualities. The TAT, which is more hetero- 
geneous in its make-up, contains some cards 
in which the characters are difficult to dis- 
tinguish and other cards in which the char- 
acters involved are easily distinguished, but 
the feelings they are experiencing or actions 
engaged in are not readily apparent. 


Background Characteristics 


Here one deals with the environment both 
psychological and physical in which the test 
is given. Questions of concern are the purpose 
of the testing from the point of view of the 
subject and from the point of view of the 
examiner. Is the test given to obtain norma- 
tive data from college sophomores, or to de- 
termine whether a “model prisoner” is to be 
paroled? Other variables influencing the re- 
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sponse will be the examiner’s sex, age, attrac- 
tiveness, and interest in the subject. 


Personality Characteristics 


Within the construct of personality one 
deals with the subcategories: (a) organismic 
needs and (4) learned needs. Examples of or- 
ganismic needs are hunger, sex drive, thirst, 
and fatigue. Learned needs have to do with 
cultural values and ego needs. The two, of 
course, may well interact in that one might 
drink a cup of tea (organismic need) while 
holding the cup and saucer in a culturally 
prescribed manner (learned need). 

The perception of such needs on a projec- 
tive technique is a function (a) of the in- 
tensity of the need and (b) the expectancy of 
satisfying that need. These factors have been 
pointed out by Rotter (1954). The impor- 
tance of Factor b in the manifestation of the 
projected need may be illustrated through ref- 
erence to the work of Brozek, Guetzkow, and 
Baldwin (1951). Using males subjected to a 
semistarvation diet for 24 weeks, the authors 
reported no significant increase in perception 
of food on the Rorschach. It should be ap- 
Parent, therefore, that the presence of a need 
without the means of satiating it may inhibit 
the perception of objects relating to the need 
rather than sensitizing one to them. The work 
of Levine, Chein, and Murphy (1942) also 
Seems to substantiate this conclusion. 

Lastly, the S himself 


Covert as in unconscioy 

It would seem, the 
underestimating the i 
lus and background 
have underestimated 


save that the same information might have 
been obtained more economically (both from 
the point of view of time as well as money) 
through a brief interview. If, on the other 
hand, the S’s defenses prevent the free ex- 
Pression of his problem, it has been assumed 
that the character of his defenses may be 
analyzed in order to get at the problem. In 
short, no response is held to be an “accident.” 
In its broadest sense this statement is doubt- 
lessly true. From an empirical standpoint, 
however, many responses are “error variance” 
or superfluous to the problem which the cli- 
nician seeks to answer. Thus, on the Ror- 
schach one might obtain a response to the 
white space of Card 2 of “A new type of jet 
plane. I saw it yesterday on television.” The 
response ostensibly may have little to add to 
the understanding of the S. But the clinician 
might think, “Why of all the possible objects 
he saw yesterday, did he happen to report a 
jet airplane?” The S$ might well state that he 
had seen other planes, ships, etc., but that 
this particular space seemed to rather closely 
resemble “the delta-swept wing jet.” Such an 
answer would rarely satisfy some clinicians. 
It is unfortunate that the effect of stimulus 
properties in determining a response is so 
thoroughly neglected in favor of wholly sub- 
ject-oriented interpretations. 

Another obstacle in the understanding of 
projective techniques has been the failure to 
accept the view that even with severely dis- 
turbed persons, some defenses may be impos- 
sible to pierce from an analysis of the data. 
The omission of response as occurs in a Ror- 
schach record totaling only five responses, iS 
probably indicative of “something,” but that 
“something” will rarely be apparent from the 
analysis of the five responses. 

If we are to build a theory of projective 
techniques, much more data are needed with 
regard to the roles played by the stimulus, 
background, and personality variables. This 
Paper undertakes an analysis of the effect of 
stimulus variation of TAT-type pictures to- 
ward the end of systemizing and interpreting 
Some of the data already obtained. It will at- 
tempt to list the key studies in this area and 
to clarify the importance of the findings for 
projective test theory. 
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Stimulus Variations with TAT-Type Tests 


Stimulus variations have been used with re- 
gard to light control, length of time cards 
have been exposed, changes in the construc- 
tion of the drawings, and number of possible 
interpretations that might apply to each card. 
It is proposed to consider the work done in 
each of these areas to determine their effect 
upon the responses obtained. 


Variations in Lighting 


Weisskopf (1950a) had college students 
write descriptions of several TAT cards which 
were presented either in an unaltered form, 
or as pictures taken under reduced exposure, 
giving the pictures a hazy effect. No signifi- 
cant differences in “transcendence” (mean 
number of responses going beyond pure 
description) were obtained. More recently, 
Bradley and Lysaker (1957), using a life- 
like TAT type picture, varied the illumina- 
tion from normal to three successive darker 
stages of illumination, as well as three lighter 
ones. The Ss were several hundred house- 
wives (range 122 to 171 for each stage) with 
each S seeing the picture in only one stage. 
Similar to Weisskopf’s (1950a) finding, no 
difference in productivity of response was 
noted. In analyzing the content of associa- 
tions with regard to the picture, however, a 
clear positive linear relationship was found 
between increasing degree of darkness and 
pleasantness of association. When the picture 
was used with a varying degree of increasing 
light, the picture slightly lighter than the 
control elicited the most favorable associa- 
tion, followed by the next lighter picture, the 
lightest picture, and the control picture. The 
effect of light was apparently not a linear 
function, with a moderate amount of supra- 
normal illumination considered most pleas- 
ant, and either more or Jess illumination con- 
sidered less pleasant. 

It seems clear that with the absence of 
light, the stimulus properties of the picture 
became increasingly vague, thus resulting in 
an increasing “internal” perception on the 
part of the S. In the relative absence of sen- 
sory stimulation, a person finds it easier to 
introspect and to relate personal material 
with considerably less inhibition than under 


normal circumstances. The soothing yet fan- 
tasy enriching effect of darkness is what 
makes a motion picture more enjoyable in a 
“movie” house than under the semilighted 
atmosphere of a television room. Moreover, 
many psychotherapists have their seating ar- 
ranged so as to be out of the patients’ direct 
gaze on the assumption that there is less in- 
terference with the patients’ private thoughts. 
Here, too, the darkened room is often more 
likely to educe free association than is the 
normally lighted one. 

The supra-illumination effects are more diffi- 
cult to interpret. Possibly, a limited amount 
of extra light obscures the picture and per- 
mits pleasant fantasies to be evoked. An in- 
creasing amount of light may be irritating to 
the nervous system and accordingly elicit less 
pleasant associations. The relative lack of 
“pleasantness” occurring under normal illu- 
mination may have stemmed from the stimu- 
lus properties being most clear at this stage, 
and hence the subjects having been more 
likely to respect the neutral emotional tone 
of the picture (woman baking a cake). 

The question may arise as to why an asso- 
ciation elicited under less than optimal sen- 
sory conditions should be pleasant rather 
than unpleasant. Two factors may be sus- 
pected of playing a part here. In the first 
place, fantasy often occurs as a temporary 
vicarious means of satisfying needs and ten- 
sions which are as yet unsatisfied in the outer 
world. The teen-age girl dreams of a prince 
charming, the young executive imagines him- 
self as a junior vice-president. Many of our 
fantasies are thus related to a need to suc- 
ceed in a variety of activities, the attainment 
of which would be associated with pleasant 
feelings. It is, of course, true that unpleasant, 
even hostile, tensions may also be present. 
The young girl may be annoyed because a 
rival seems to have currently won her prince 
charming; the young executive may chafe 
under the imposition of being a “yes” man 
to the “boss.” Nevertheless, militating against 
the appearance of hostility on the TAT 
would be the fact that the S would probably 
deem the testing situation as inappropriate 
for the expression of hostility. The inhibitory 
effect of the “background” might be due to 
a weak generalization gradient from hostility 
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to the “boss” to hostility in an ambiguous 
situation, or the S might simply inhibit all 
expression of hostility because he felt he was 
being judged and he wanted to make a good 
impression. Since it is socially acceptable to 
perceive pleasant things and not as accept- 
able to perceive hostility in others, it is more 
than likely that when the stimulus proper- 
ties of the object being perceived are weak 
enough, the S will be apt to fantasize pub- 
licly only over a narrow band of ideation, 
namely, those topics which do not conflict 
with what the S perceives to be the ego de- 
mands of the social situation in which he is 
involved. 


Variations in Time Exposure 


Weisskopf (1950a) presented college Ss 
with 2 sets of TAT pictures exposed for .2 of 
a second and for 5 seconds, The latter group 
manifested a higher number of fantasy scores 
(“transcendence”) Kenny ( 1954) exposed 
the TAT pictures to college Ss for 5 seconds 
and 2 minutes, respectively. The correlation 
between “Personality tevealingness” of the 
themes elicited and “transcendence” was .62 
and -64 for the 5-second and 2-minute con- 
ditions of exposure. 

Apparently, the individual fantasizes with 
greater personal involvement as well as 
greater productivity when he has sufficient 
time to appraise the stimulus qualities of the 
card. After a sufficient time has elapsed 
(optimally, perhaps, a few seconds), added 


length of exposure has little effect, 


Variations in the “Ground” 


Completely traced 
be more effective i 


Murstein 


Variations of Central Figures 


Thompson Modification. Murray (1943) 
suggested that at least one card should be 
chosen, showing a figure of approximately 
the same age and sex as the S. Tomkins 
(1947), on the other hand, has proposed that 
the TAT may be interpreted most meaning- 
fully by taking into account the psychologi- 
cal distance of the stimulus from the S. More- 
over, the meaningfulness of the responses 
elicited by the TAT should be a function of 
the “remoteness” of the thematic material 
presented. 

Thompson (1949), adhering to Murray’s 
suggestion, believes that the closer the stimu- 
lus resembles the actual S, the more the S 
will identify with the figure and, accordingly, 
be likely to produce more meaningful mate- 
rial. To test this hypothesis, he constructed 
a set of TAT cards similar to the original 
TAT, except that Negro characters were sub- 
stituted for white ones, Using 26 Negro 
college students from a Negro school, the 
Thompson TAT was group-administered by 
a Negro examiner who flashed the cards on 
a screen by means of a projector. The Ss 
were instructed to write stories to the pro- 
jected pictures. In order to compare the Mur- 
tay and Thompson versions, the Ss were di- 
vided into two groups of 13 each, with half 
receiving the Thompson series first and the 
Murray version second, while the other half 
received both series with the order of pres- 
entation reversed. Thompson found a signifi- 
cant increase (p < .01) in story length to the 
Thompson TAT for each of the 10 cards 
used. 

More recent studies, however, have bee? 
highly critical of the value of the Thompson 
modification. Riess, Schwartz, and Cotting- 
ham (1950) used 30 Negroes and 30 white 
females from Hunter College in New York 
City. The usual AB, BA order for the two 
TAT tests was followed, using a Negro ex- 
aminer for half of both the Negro and white 


group, and a white examiner for the other 
half. The results were: 
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story length on Negro stimulus material with a Ne- 
gro examiner (Riess et al., 1950, p. 708). 


In another article using the same data 
(Schwartz, Riess, and Cottingham, 1951), 
the authors investigated the number of ideas 
appearing in the stories rather than merely 
the story length. Their data showed that (a) 
Negroes expressed the most ideas when given 
the cards by a white examiner. The set of 
cards used was of little consequence. (b) 
Whites gave more ideas when the Thompson 
set was used. This result was not a function 
of whether the examiner was white or Negro. 
(c) The production of ideas was quite low 
when the stimulus, examiner, and Ss were of 
the same race. 

Korchin, Mitchell, and Meltzoff (1950) 
used two groups of 80 Negro and 80 white 
male Ss from Philadelphia, half of each group 
being “middle class” while the other half was 
of “low” socioeconomic status. The examiner 
was white. An analysis of variance showed no 
significant effects due to race, nor any sig- 
nificant interaction between race and status 
for story length. Only the “class” differences 
were significant ($ < .01), with the “middle 
class” telling the longer stories. 

In still another experiment, Light (1955) 
divided 26 white students into two groups of 
13 each, one-half receiving the Murray TAT, 
while the other received the Thompson ver- 
sion. No significant differences in story length 
were found, although Light found certain 
themes to be more frequent with the Thomp- 
son set. These themes were crime, poverty, 
occupational inferiority, witchcraft, and pros- 
titution. 

Cook (1953) used 60 male college students 
(30 Negro, 30 white), divided into 4 groups 
of 15 each. One-half of the Negro and white 
groups each received the Thompson TAT, 
while the remaining two groups receiving the 
Murray TAT were composed of the remain- 
ing Negro and white Ss, respectively. The ex- 
aminer here also was white, and most of the 
Ss had spent at least 15 years in the South. 
Cook wished to examine the relationship be- 
tween tendency toward ego-defensiveness as 
a function of a decrease in remoteness be- 
tween the S and the stimuli used. The meas- 
ures of ego-defensiveness used were word 


count, compliance with instructions given, 
vagueness of stories, number of words indi- 
cating uncertainty, number of alternatives of- 
fered, number of references to the pictures 
(i.e., excessive use of description), and num- 
ber of different themes offered. No significant 
differences solely attributable to the two sets 
of pictures were found. Both the Negroes and 
whites were interviewed with regard to their 
perception of the test. It was found that the 
great majority of the Negroes perceived both 
the Murray and Thompson TATs as dealing 
with “people in general.” On the other hand, 
the whites perceived the Thompson TAT as 
dealing with Negroes rather than “people in 
general.” Hence, it would be expected that 
the chief differences between the Negro and 
white Ss would be found with regard to the 
Thompson TAT. This was precisely what 
happened. The Murray TAT yielded only 
two significant findings at the .05 level. Ne- 
groes used more words indicating uncertainty 
and made more references to the pictures. 

On the Thompson TAT, however, the pro- 
tocols of the whites had a significantly higher 
word count. The Negroes had a greater num- 
ber of alternatives, uncertainty, vagueness, 
and references to the pictures. All measures 
were significant beyond the .01 level. Cook 
believed his findings indicated that the more 
remote the relationship between the stimulus 
and the S, the less the ego-defensiveness. 

The foregoing studies lead to a considera- 
tion of the following: 

1. Are Negroes to be treated as a homo- 
geneous class? The data hardly suggest that 
such a treatment is warranted. Apparently, it 
would be more justifiable if anything to use 
a “socioeconomic class” approach to inter- 
pretation. 

2. The degree of similarity between stimu- 
lus and subject is of itself insufficient as an 
explanation of the type of response elicited be- 
cause it does not take cognizance of the back- 
ground characteristics. Thus, in Schwartz’s 
(1951) work, Negro Ss who were adminis- 
tered Negro cards by a Negro examiner 
manifested a smaller number of ideas in their 
stories than any other grouping. Negro Ss re- 
ceiving the same cards from a white examiner 
expressed the greatest number of ideas. For 
the white Ss, however, the Negro cards 
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seemed to educe the greatest number of ideas 
regardless of the race of the examiner. 

3. In view of the fact that the Stimulus x 
Background X Person interaction seems to be 
of considerable importance in determining the 
nature of the response, the ¢ test favored by 
previous investigators would appear to be a 
relatively insensitive statistic. The analysis of 
variance would appear to be more powerful 
in this regard. 

4. The question arises as to whether story 
length or number of ideas expressed is an ade- 
quate measure of the S’s involvement in the 
TAT. Is it not conceivable that sophisticated 
Ss (college students) might manifest an ex- 
cessive superficial verboseness to mask the 
projection of manifest or covert needs? What 
is needed is a quantitative scale measuring 
the personality meaningfulness of the Stories 
rather than indirect and unproven correlates 
such as “word-count” and “number of ideas,” 
stimulus is not a 
rity to the S. The 
in the interpreta- 
ended to perceive 
S not as “whites” 
Whites, however, 
ds as dealing with 


» however, must con- 


(Goodman, 1952) 


prise. When, however N 
with the Thompson faces 


the presence of a white exa 


e confronted 


tious and vague. 


Other Modifications. Las i 
and Martinez-Arango (1946), in pet 
with nuns, found no improvement in the dive: 
nostic value of the TAT stories when th, ; 
substituted nuns for the usual TAT Genta] 


figures. Weisskopf and Dunlevy (1952) used 
three groups of 10 each of normal, crippled, 


. and obese male undergraduates. Each S re- 


ceived three sets of TAT cards, one of which 
was unmodified, the other sets being modi- 
fied so that the central figure was obese in 
one set and crippled in the other. The Ss 
were asked to describe the cards rather than 
to tell a story. The results indicated that the 
mean transcendental index (number of ele- 
ments in the stories going beyond pure de- 
scription) was significantly less for the obese 
figures than for the normal and crippled ones. 
This trend was consistent among all three 
groups. 

In another study, Weisskopf-Joelson and 
Money (1953) modified the TAT with some- 
what crude approximations of the original 
drawings. In the first series, the head of the 
central character was a more or less neutral 
face. In the second session, the same cards 
had actual photos of the Ss’ heads instead of 
the original neutral heads. A control group 
was used to account for the effect of repeti- 
tion. No significant increase in projection was 
found for the “photo” set over the neutral 
set as measured by the transcendence index 
and word content. In addition, the diagnostic 
value of the “photo” set when judged by two 
judges was not found to be any higher than 
the other set. 

In a recent study by Edgar and Shneidman 
(1958), a group composed of psychotics, psy- 
choneurotics, and persons suffering from per- 
sonality disorders was used. Material obtained 
from “patient government” discussions was 
compared with that obtained from the MAPS 
technique, and a variation of this technique, 
in which full length cut-out photos of every 
Person in residence on the ward at the time 
as well as all staff members, was used. Using 
Bales Interaction Process Method to analyze 
the data, the authors found as much reluc- 
tance to show antagonism to photos of pee! 
figures as to peers in face-to-face contacts ° 
such as occasioned by the group meetings. 
They suggest that one use of the “photo 
technique may be in measuring the feeling® 
of need for evaluation from others and feel- 
ings of need for direction. Nevertheless, the 
authors concluded that “photos, in general, 
Seem to elicit more positive feeling than fan- 
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tasy figures did, the latter calling forth more 
overt aggression” (Edgar and Shneidman, 
1958, p. 11). 

It would appear then that similarity of the 
central character to the S is not only non- 
effectual in furthering projection but actually 
may be detrimental. Since obesity is the butt 
of jokes in our society, it is unlikely that 
fat persons derive any satisfying tension re- 
duction in identifying with obese characters. 
Before concluding, however, that similarity 
per se inhibits projection, it may be of value 
to recall that the background characteristics 
(purpose of the experiment) are much more 
readily apparent to the S under these condi- 
tions. Thus, while the S taking the TAT un- 
der the usual nomothetic experimental pro- 
cedure may not suspect that his responses as 
an individual will be noteworthy, the S who, 
as in Weisskopf-Joelson and Lynn’s study 
(1953), sees a photo of his head planted 
somewhat out of context on a crude sketch 
may not suffer this delusion. 3 

It may be that under nonsocial conditions 
similarity might well stimulate projection. In- 
deed, the mirror probably does richly stimu- 
late fantasies in teen-agers as they carefully 
prune themselves before going out on a 
“heavy date.” Some support for this state- 
ment comes from the data of Beier, Izard, 
Smock, and Tougas (1957) who gave young 
adults sets of photos of younger, peer, and 
older persons having them signify the ones 
liked and disliked. Male Ss most frequently 
“liked” peer males while female Ss preferred 
peer females. 

In sum, however, as far as the usual test- 
ing procedure is concerned, it seems clear that 
similarity to the point of idiosyncratic identi- 
fication promotes ego defensiveness and a re- 
duction in the degree of projection. 


The Use of Animals Instead of Humans 


Bellak and Bellak (1949), believing that 
children identify more readily with pictures 
Containing animal figures than with human 
ones, created the Children’s Apperception 
Test. Bills (1950) compared a series of pic- 
tures of rabbits with several TAT cards using 
as Ss children (both male and female) aged 
five through ten. Significantly longer stories 


were obtained with the “rabbit” pictures. In 
another study (Bills, Leiman, & Thomas, 
1950), a new group of third-grade Ss had six 
play-therapy sessions and then took the “rab- 
bit” pictures test and TAT. Both tests corre- 
lated only slightly with the material obtained 
from play therapy using Murray’s rating ap- 
proach for manifest needs. Their correlations 
with each other also were rather low, ranging 
from — 09 to .58. 

Biersdorf and Marcuse (1953) used a broad 
approach to the problem employing CAT 
cards and cards specially constructed, which 
were almost identical to the CAT cards ex- 
cept that humans were substituted for the 
animals while keeping the same emotional ex- 
pressions. The Ss were 30 first graders, the 
group containing both sexes. Not only were 
no significant differences found between num- 
bers of words used in both tests, but further 
analysis revealed no difference in length of 
time before response, length of response time, 
number of words used, number of ideas used, 
number of characters mentioned in the pic- 
tures, and the number mentioned who were 
not in the pictures. Mainord and Marcuse 
(1954), using the same sets of cards, tested 
emotionally disturbed boys and girls (mean 
age, seven years) and found similar nonsig- 
nificant differences for the aforementioned 
quantitative measures. They, however, also 
asked five clinicians to rate the protocols as 
to “clinical usefulness,” the judges being ig- 
norant of the hypotheses of the authors and 
the stimulus properties of the cards eliciting 
the protocols. The human figure cards were 
found to be more “clinically useful” at better 
than an .001 level of confidence. 

In yet another study comparing the CAT 
with its “humanized” analogue, Furuya 
(1957) studied the protocols of 72 children 
ranging in age from 6 to 12. He was inter- 
ested in answers to the following two ques- 
tions. 

1. With different criteria and age-groups— 
from those of Biersdorf and Marcuse (1953) 
and Mainord and Marcuse ( 1954)—what 
kind of difference will be found between the 
productivity to animal pictures to human 
pictures, equivalent in scenes and situations? 

2. Is there any tendency toward relative 
decrease of productivity to animal pictures 
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compared with human pictures as the children 
grow older (Furuya, 1957, p. 248)? 

The results are confounded with methods of 

presentation in that the youngest children re- 
ceived the cards individually, while the older 
ones received the cards as a group. Neverthe- 
less, the results are consistent with earlier 
studies in indicating the superiority of the 
human pictures. Of the 20 ¢ tests, four proved 
to be significant at the .05 level or better. 
These indicated that the percentage of stories 
containing expressions of feeling, significant 
conflict, and having a definite outcome, was 
significantly higher for the human pictures 
as compared to the animal ones, 

No tendency was found for any increase or 
decrease in the relative productivity of the 
animal or human pictures from the youngest 
to the oldest age range. 

Lastly, the author implies that the results 
might have been even more extensive but for 
the fact that “most of the animal pictures 
that have been used, were ‘personified or hu- 
man-like’ animal pictures” (Furuya, p. 252). 

Light (1954), working with 9- and 10-year- 

olds, found significant differences between the 
CAT and TAT. The TAT was found to elicit 
more feelings, different kinds of feelings, con- 
flicts, number and kinds of out 


a comes, num- 
ber and kinds of themes, and number of fig- 


flashed on a 


R 3 Ei 
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strong, 1954; Biersdorf and Marcuse, 1953), 
the human pictures have been shown to be 
equal or superior to the animal pictures. The 
only negative note sounded (Bills, 1950) 3 
not strictly comparable since the “rabbit pic- 
tures” utilized may have been conducive to 
projection due to the nature of the situation 
portrayed on the cards rather than to the 
Presence of animal figures of themselves. 


Variations in Ambiguity Between TAT Cards 


Murray (1943), in the manual for the The- 
matic Apperception Test, described the cards 
as “. . . divided into two series of ten pic- 
tures each, the pictures of the second series 
(numbers 11 through 20), being purposely 
more unusual, dramatic, and bizarre than 
those of the first. One full hour is devoted to 
a series, the two sessions being separated by 
a day or more” (p. 2). 

Weisskopf (1950a) found that college stu- 
dents, when asked to describe both sets, pro- 
jected significantly more fantasy material to 
the first “everyday” series than to the lat- 
ter “fairy tale” one. Of interest also was the 
fact that women tended to have significantly 
higher “transcendence” indices than men for 
both the “male” (p < .02) and “female” se- 
ties (pb < .05). A heterosexual group of col- 
lege students were asked by Bijou and Kenny 
(1951) to rank 21 “male” series TAT cards 
according to their ambiguity (estimated num- 
ber of interpretations that might be derived 
from each card). The authors computed a ¢ 
test between the mean ambiguity level for the 
first Murray series as compared to the second 
one. The second “fairy tale” series proved to 
be more ambiguous, at the .05 level of con- 
fidence, although the authors did not reject 
the null hypothesis in postadopting an 01 
level. They also compared the “personality 
revealingness” value of the first series as com” 
pared to the second one by analyzing the 
themes of the TAT stories (Kenney a” 
Bijou, 1953). The mean “personality reveat- 
ingness” value of the “everyday” series proves 
to be somewhat higher than the “fairy tale 
Series, but the ¢ test of .92 was not statisti- 
cally significant. 

Using the same “ 


male” series of 21 cards 
the authors found 


a tho of .75 between 2 


eens 
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male and 23 female college students. Since 
the multijudge reliability was .80, there ap- 
peared to be little sex difference with regard 
to the judgment of ambiguity. Dividing 15 
cards, selected from the 21, into three groups 
of 5 cards each, according to their high, me- 
dium, or low ambiguity, they found that the 
medium-ambiguous series yielded themes of 
greater “personality revealingness” than either 
the low or highly ambiguous series. The dif- 
ference in “revealingness” was not a function 
of the length of the story told. Dividing the 
15 cards into the dichotomy used by Murray, 
8 were found to belong to the “everyday” se- 
ries, while 7 were assigned to the “fairy tale” 
series. No significant difference in “transcend- 
ence” was found between the two groups of 
cards. The interaction between ambiguity, 
“transcendence,” and exposure time showed 
that the medium-ambiguity pictures yielded a 
greater amount of “transcendence” than the 
high-ambiguity ones under long exposure 
time (2 minutes) but not under short ex- 
posure time (5 seconds). The medium-am- 
biguity group of pictures did, however, show 
a higher “transcendence” than the least am- 
biguous pictures under both long and short 
exposure time. 

Murstein (1958b), using Bijou and Kenny’s 
(1951) rankings of ambiguity of a “male” se- 
ries of cards with some modifications, found 
significant curvilinear correlations with the 
number of themes elicited from an all-male 
population composed of both college students 
and psychiatric patients used by Eron (1950). 
The moderately ambiguous cards produced 
the most themes, while the high- and low- 
ambiguous cards were less productive. While 
the curvilinear correlation involving the het- 
erogeneous group and male-only group proved 
to be highly significant, the use of the fe- 
male rankings of ambiguity did not yield a 
significant difference between eta and the 
Pearson r. The range of etas was from .43 to 
.95, the Pearson’s 7’s ranging from .03 to .09. 

In another study, Murstein (1958a) had 12 
female Ss rank a “female” series of 20 cards 
for “pleasantness” as well as for “psychologi- 
cal ambiguity.” When compared to the “emo- 
tional tone” scores obtained by Eron (1953) 
from a similar female population, the follow- 
ing average correlations were obtained: am- 


biguity vs. emotional tone, .56; ambiguity vs. 
pleasantness, .40; pleasantness vs. emotional 
tone, .59. Thus, the results indicated that the 
more ambiguous the TAT card, the more 
“pleasant” the “emotional tone” of the story 
was found to be; the more “pleasant” the 
stimulus properties of the card, the more 
“pleasant” the “emotional tone” of the stories. 

The results of the ambiguity experiments 
seem to show that the more ambiguous a pic- 
ture is, the more pleasant are the themes 
elicited in the stories told to it. The more 
structured pictures are usually negatively 
structured (Murstein, 1958a) and, hence, 
more likely to elicit unpleasant themes. 
The medium-ambiguous pictures usually elicit 
more themes as well as more “personality re- 
vealing” material. 

In appraising the work reviewed in this pa- 
per the following conclusions seem warranted: 


Conclusions Derived From TAT Modifica- 
tions 


1. A lack of visual stimulation (darkness) 
seems to enhance the occurrence of pleasant 
association to TAT-type cards. The effect of 
supranormal illumination is more complex 
with a slight increase resulting in a mani- 
festation of more pleasant responses than un- 
der normal lighting. As the intensity of illu- 
mination is further increased, however, the 
pleasantness of association diminishes. 

2. Mere similarity between the S and the 
central figure in the stimulus card is insuffi- 
cient to expedite the projection of mean- 
ingful responses. Projection is most readily 
elicited when the stimulus figure is culturally 
high in status and yet not so similar to the 
S as to arouse his suspicion as to the pur- 
pose of testing. It is not similarity per se that 
accounts for the censoring of responses, but 
the new awareness of the background charac- 
teristics (ie., purpose of the testing) which 
causes the S to filter his responses. Other 
background factors such as the race of the 
examiner may also play a part in determin- 
ing the nature of the response elicited. 

3. The fact that Negro Ss when tested by 
white examiners tend to be superficial in ap- 
proach, hewing closely to mere description of 
the thematic cards, hardly means that they 
do not have tensions which could be percep- 


12 


tually expressed. Rather, the Jack of involve- 
ment may have been a function of a low ex- 
pectancy of satisfying these needs even to the 
extent of verbalizing them, because of the 
inhibiting presence of the examiner. With a 
Negro examiner, however, the stories told by 
Negroes would probably be more meaningful, 
though this particular comparison has not as 
yet been made. ; 
The tendency of whites to give richer 
stories to the Thompson series rather than to 
the Murray TAT would seem to be a way of 
expressing either a need for verbalization of 
tolerance or a feeling of freedom in talking 
about a socially subservient group. Presum- 
ably, the Northern Ss would be most prone 
to strive for tolerance in their stories, while 
Southern students (Light’s group?) might be 


more apt to play upon the social and eco- 
nomic inferiority of Negroes. 


4. Racial differences as deter 
jection have been overestimate 
economic factors have been 
Middle-class Negroes may have 
mon with middle-class whites w 
perceived needs, than have mid 
groes with lower-class Negroes. 

5. Animal pictures have been shown to be 
somewhat less effective than human pictures 


in eliciting meaningful projective responses 
from children, 
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background factors such as the personality 
of the examiner, the reason the test is being 
given, and the locale of the test, become in- 
creasingly important. It seems reasonable to 
assume that most persons for cultural reasons 
prefer to see “good” rather than “bad.” Also 
of importance for college students who form 
the hard core of Ss used in these experiments 
is the need of impressing and favorably in- 
fluencing the examiner who may well be per- 
ceived as a teacher-surrogate. Under these 
conditions, the exceedingly ambiguous pic- 
ture may act as a cue to set the S on his 
guard to put his best perceptual foot for- 
ward. 

4. The effect of varying the time of ex- 
posure is minimal provided the S may per- 
ceive the cards for at least a few seconds. 
Presenting the card for only a fraction of 4 
second seriously affects the productivity of re- 
sponse. Allowing the picture to be exposed 
for two minutes has little if any advantage 
over showing it for five seconds. 

5. The area of sex differences with regard 
to stimulus ambiguity is largely unknown. 
More information might be obtained if both 
Sexes were given both the “male” and “fe- 
male” series and comparisons made taking 
into consideration the sex of the figure de- 
picted on the cards, , 

The knowledge that medium-ambiguous 
pictures produced the richest material per- 
sonality-wise in the studies reviewed repre- 


sents only a beginning in the understanding 
of the relationshi 


ties of the TAT 
Mediu 


of per 
refer 


ng idiosyncratic pro- 
are cards which contain hu- 
mans who are fairly easily identified but 
whose expressions and feelings are capable of 
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multiple interpretation. Thus, in Card 13 MF 
it is obvious to most persons that an appar- 
ently nude woman is lying beneath the covers 
of a bed, while a young man stands fully 
clothed with his arm covering his face. The 
ambiguity resides only in what the characters 
are doing and feeling. Maximum use ought to 
be made, therefore, of cards clearly depicting 
humans, whose behavior, however, is not 
readily discernible. Such cards would appear 
to have more appeal for Ss than fantastic 
“fairy tale” type pictures, at least with regard 
to normal populations. 

In reviewing the earlier studies, the impor- 
tance of stimulus control and background fac- 
tors has been shown to play crucial roles in 
the elicitation of responses to TAT-type tech- 
niques. It would appear that the emphasis 
upon the TAT’s ability to tap the “private 
world” of the individual has hindered cli- 
nicians from fully utilizing other equally 
meaningful determinants of perception. In 
fact, one of the key repeating factors seem- 
ing to run through the studies covered has 
been the fact that this “private world” has 
been revealed only under rather specific con- 
ditions and with specific cards. One must con- 
clude, therefore, that much of the thematic 
material educed is obtained with the permis- 
sion of the S, and is subject to his control. 
This statement is in accordance with Lindzey 
and Tejessy’s finding (1956) that TAT hos- 
tility indices correlated more highly with the 
Ss self-concept than with observer or clinical 
ratings. Moreover, Allport (1953) has said, 
“normal subjects . . . tell you by the 
direct method precisely what they tell you 
by the projective method. They are all of a 
piece. You may therefore take their motiva- 
tion statements at their face value, for even 
if you probe, you will not find anything sub- 
stantially different” (p. 110). a i 

If the Ss’ control of the testing situation 1s 
so pervasive, how can we, as clinicians, de- 
sign tests so as to circumvent this Control and 
obtain meaningful glimpses into that private 
world” which is not offered for public con- 
sumption? The earlier work seems to indi- 
cate that medium-ambiguous pictures should 
be used where the figures are humans, cul- 
turally acceptable as objects of identification 
and yet not so similar to the S as to cause 


him to become overly self-conscious and 
heavily censor his responses. 

Finally, the task of quantifying the stimu- 
lus, background, and organismic variables is 
a formidable one. The stimulus value of per- 
sonality variables such as aggression and sex, 
has been scaled for TAT-type pictures, using 
the Guttman scaling technique (Auld, Eron, 
and Laffal, 1955). Examiner attitudes and be- 
havior could also be measured through an 
amalgam of scaling procedures and observa- 
tion and personality tests, as could the be- 
havior of the S apart from the testing situa- 
tion. The quantification of these variables 
would lend meaning to the responses obtained 
via the projective techniques. Currently, for 
example, one is often at a loss to determine 
whether responses on the TAT reflecting hos- 
tility are part of the S’s perceptual world or 
merely reflect a respect for the objective 
properties of the cards. By means of the 
Stimulus X Background x Organismic ap- 
proach, however, such questions may be an- 
swered as well as ones regarding the relation- 
ship between responses and overt behavior. 
Such an approach may well lead to a more 
homogeneous thematic theme test whose 
stimulus values are known for various per- 
sonality dimensions with regard to different 
populations, thus mitigating the manifold 
problems of interpretation. 
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regards the classifications as reaction patterns 
rather than disease entities. This is the cur- 
rent status of the Veterans Administration’s 
nomenclature, adopted in 1952. 

The importance of the behavior patterns in 
the schizophrenic reactions was pointed out 
by Adolf Meyer. He and his students, notably 
Norman Cameron, emphasized the influence 
of social factors in the development, onset, 
and form of these reactions. Indeed, Cameron 
(1947) prefers to include the schizophrenics 
under a broad classification of Behavior Dis- 
orders. The implications which arise from the 
use of “disease,” “symptoms,” “mental ill- 
ness” are thus avoided by Cameron. 

The assessment of behavioral adjustment 
offers another approach in the evaluation of 
psychiatric patients. Many psychiatric pa- 
tients who exhibit a minimum of psychiatric 
symptomatology are unable to leave a men- 
tal hospital and lead productive lives. Other 
patients, despite extensive psychopathology 
leave mental hospitals and become produc- 
tive citizens. The extent of psychopathology 
therefore, is not necessarily related to the 
adequacy of social functioning, although there 
is generally a high incidence of behavioral 
maladjustment in severely “ill” psychiatric 
patients. 

This paper, then, presents some data on 
the relationship between behavioral adjust- 
ment and psychopathology as related to each 
other and to the level of posthospital adjust- 
ment. Perhaps the most stringent criterion of 
any measure of adjustment in psychiatric 
patients is the relationship between such a 
measure and posthospital adjustment. Such 
an analysis is also attempted in this paper 
relating level of behavioral adjustment and 
psychopathology at time of discharge to the 
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level of social adjustment three months fol- 
lowing discharge. 


Procedure 


Between August 1956 and May 1957, every 
functional psychotic patient under 60 years 
of age, without major physical illness, having 
been hospitalized no longer than 90 days dur- 
ing the preceding 6 months, admitted to the 
Fort Douglas VA Hospital, became a subject 
in this study. The patient was interviewed 
upon admission and rated (RBE) on a psy- 
chopathology scale. A psychiatric nurse and 
aide rated him independently on a behavioral 
adjustment scale following three days’ obser- 
vation. All personnel using the behavioral ad- 
justment scale were trained raters. 

For purposes of this study, part of this 
admission group (V = 78) was broken into 
two additional subgroups for further study: 
1. Those who were discharged from the hos- 
pital within 6 months (N = 27). The pa- 
tients in this group were interviewed and 
again rated on the Psychopathology scale at 
the time of discharge, and were also rated in- 


dependently by a psychiatric nurse and aide 
on the behavioral adjust: 


time. Twenty-five of the 


see oat Lorr Multi-dimensional Ratin, 
was used j i 
ae a Owe in this study, The Lorr 


raters independently rating 52 patients). The 
items that remained included manifest and 
reported depression, manifest and reported 
anxiety, apathy, reported hallucinations, de- 
lusions or morbid suspicion, thought disor- 
der, rapport, disorientation, bizarre posturing, 
memory deficit, lack of motivation, excessive 
hostility, withdrawal, evasion, and coopera- 
tiveness. These items represent, then, a sam- 
pling of Lorr’s psychopathology factors. 

Seven psychiatrists were asked to judge: 
“at what level (rating) each symptom would 
have to be manifest in an interview before 
you would be confident of the presence of 
underlying Psychopathology.” The level at 
which at least 6 out of 7 agreed, was accepted 
as the psychopathology level, All 7 agreed 
completely on 74% of the items. Each level 
beyond this judgment Was scored 1 point to- 
ward a Total Psychopathology score. Seven- 
teen items (described above) were judged 
as indicating Psychopathology, On these 17 
items, a patient could score 31 pathology 
Points, since most items contained 2 levels 
(ratings) beyond the judged point of psy- 
chopathology. A Total Psychopathology score 
was thus obtained; the higher the score, the 
more extensive the Psychopathology. Along 
with the author one additional rater inde- 
pendently rated 17 Patients with a resultant 
tho of .84 between the Total Psychopathology 
scores for the 2 raters. The reliability of the 
Total Psychopathology score was thus found 
to be within acceptable limits, 

An intercorrelational analysis of all psycho- 
Pathology items (phi correlation, N of 78 rat- 
ings) revealed that each item was “relatively” 
independent of every other item in the scale. 
Although several items were significantly in- 
terrelated, the highest phi was -51, which ac- 
Counted for only 25% of the variance be- 


Behavioral Ad justment Scale 


The MACC Behavioral Adjustment Scale 
(1957) was used in this study. The develop- 
Ment, reliability, and validity outlined in the 
manual are not reported here. The scale meas- 
ures 4 relatively independent behavioral clus- 
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ters: Motility, Affect, Cooperation, and Com- 
munication. The latter 3 areas constitute the 
Total Adjustment score. (See Ellsworth, 
1957.) 

The ratings of 2 independent raters (nurse 
and aide) were averaged, thus decreasing the 
Interrater error. The interrater reliability of 
the 2 admission raters (Total Adjustment 
Scores, 78 paired ratings) was .89. 


Posthospital Adjustment Scale 


As part of the Psychiatric Evaluation proj- 
ect," 25 psychiatric patients were followed 
into the community and rated in 6 areas 
Of social adjustment. These included occupa- 
tional (or school) adjustment, management of 
funds, family adjustment, “other” interper- 
Sonal relationships, recreational adjustment, 
and community adjustment. One of the au- 
thors (Clayton) developed a 5-point rating 
Scale for each of these posthospital adjust- 
Ment areas, For example, a patient who Is 
employed full time receives a rating of 1 in 

e area of occupational adjustment, while a 
Patient who refuses to seek work and does 
Not help at home is rated 5. A low total score 
(for the 6 areas) thus indicates “good” post- 
Ospital adjustment, while a high score indi- 
Cates “poor” posthospital adjustment. 

_A social worker (Clayton) visited the pa- 
tient and his family 3 months following dis- 
Charge and rated each patient in the 6 post- 

Ospital adjustment areas. He was not aware 
of either the patient’s behavioral adjustment 
Or pathology ratings at the time of the inter- 
View and rating, Following the interview, he 
Wrote a narrative report describing each pa- 
Hent’s social situation and conditions under 
Which he was living, including the behavioral 
Patterns and relationships in each of the 6 
ateas of adjustment. Two additional social 
Workers independently rated all 25 patients 
‘om this narrative report, with a resulting 
average intercorrelation of -82 between all 
raters on the total scores. Thus, the Posthos- 
Pital Adjustment Scale appears to result in 
Satisfactorily reliable scores which permit the 
Scoring of each patient’s over-all posthospital 
adjustment, 

8 
tre 

A 


effectiveness of 


This VA j luate the 
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aent of several VA hospitals, 
ard L., Jenkins and Lee Gurel. 
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Results 


a. Table 1 presents the intercorrelations 
between Total Psychopathology scores and 
Behavioral Adjustment areas upon admission. 
The results indicate that the higher the be- 
havioral adjustment, the lower the extent of 
psychopathology. In other words, the more 
pleasant, cooperative, and communicative the 
patient was, the Jess apt he was to show ex- 
tensive psychopathology. The relatively high 
intercorrelations between two different kinds 
of scales, rated independently, are somewhat 
surprising. This would seem to suggest that 
these two assessment approaches of the ad- 
justment of the newly admitted patient with 
a psychotic reaction, whether it be from a 
behavioral or psychopathological standpoint, 
have much in common. 

b. The amount of improvement (score 
change) on both behavioral adjustment and 
psychopathology was analyzed. The score 
changes of Subgroup 1 (those who were dis- 
charged within 6 months of admission) were 
compared on both scales. This resulted in a 
product-moment correlation of .74 (signifi- 
cant beyond .01 level of confidence). Thus, 
the discharged patient who improves in his 
behavioral adjustment tends to show a simi- 
lar amount of improvement in his psycho- 
pathology symptoms. Both methods of as- 
sessing improvement have much in common, 
as would be expected from the results of 
Table 1. 

c. The results of Subgroup 2 (those who 
were not seen as ready for discharge at the 
end of 6 months of hospitalization) are sum- 
marized in Table 2. The mean scale changes 
of this “in-hospital group” were compared 
with the mean scale changes of those actually 
discharged before reaching the 6-month point 
of hospitalization (Subgroup 1). 

It appears that, with regard to using dis- 
charge as a criterion of “improvement,” the 
psychopathology scores do not distinguish 
between those improved sufficiently to war- 
rant discharge within 6 months and those 
who were seen as needing hospitalization be- 
yond 6 months. The behavioral adjustment 
scale scores, however, reflected a significant 
change in the “improved” (discharged) group, 


t 
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Table 1 


Intercorrelations Between MACC Behavioral Adjustment Scores and Total 
Psychopathology Score Upon Admission 


(N = 78) 
Coopera- Communi- Total 
Motility Affect tion cation Adjustment 
Total psychopathology +.49* —,51* —.70* = 65* —.69* 


* Significant beyond .01 level of confidence. Motility scores are not included in the Total Adjustment scores, 


but not in the “unimproved” group. In so far 
as this particular VA hospital operates, behay- 
ioral adjustment appears to be more highly 
related to improvement (as measured by dis- 
charge) than Psychopathology, 

d. A fourth analysis involved the relation- 
ship between the length of hospital stay with 
behavioral adjustment level and total psycho- 
of admission. In 
Predictive of the 
ch is an indirect 
psychiatric dis- 
opathology or the 


does not appear to be significantly related to 
length of hospital stay. 

e. The last analysis involved the relation- 
ship between extent of Psychopathology and 
level of behavioral adjustment at time of 
discharge, to posthospital adjustment three 
months following discharge. Thus, it was pos- 
sible to relate these two measures of the ad- 
justment of Psychiatric patients to the ade- 
quacy of Posthospital community functioning. 
The effectiveness of hospital treatment is per- 
haps best measured against the adequacy with 
which an ex-patient handles his life following 
discharge, 
In this analysis, the product-moment cor- 
relation between extent of psychopathology 
upon discharge and level of posthospital ad- 
justment was .22 (not significant, WV = 25). 
The level of behavioral adjustment at time 
of discharge, in relation to level of posthos- 
pital adjustment, was — .47 (significant be- 
yond the .02 level of confidence). Thus, the 
behavioral adjustment, as rated independently 
by a psychiatric aide and nurse at time of 
discharge, was significantly related to level 
of community adjustment 3 months follow- 
ing discharge; since the patient who adjusted 
well in the community (low score) tended to 


Table 2 
Mean Behavi j 
© Be cient ot T sychopathology Changes of Patients Not Seen as Ready for Discharge 
ose Discharged Within Six Months of Hospitalization 
Behavioral Mean Pathology Mean 
e 
Groups N fa 2b t ya 2b t 
Discharged within 6 months 27 k 
Not discharged within 6 months 11 393 43.0 ou pA is a 
* 
= Refers to the ean OF fevel of confidence, 


‘havioral and pathol 
» Refers to the mean of behavioral and > hology scores 


Pathology scores at time of hospital admission, 


at time of d; 


ischarge from the hospital, 
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have the highest behavioral rating at the time 
of discharge. 


Discussion 


Although behavioral adjustment and psy- 
chopathology might, at first glance, appear to 
be two entirely different approaches in evalu- 
ating psychiatric patients, they are both based 
on behavioral observations. Symptomatology 
might be described as abstractions from be- 
havior. For instance, two “delusional” pa- 
tients may differ widely in their behavior in 
relation to a delusion. Behavioral adjustment 
is the more concrete description of behavior, 
While psychopathology is the more abstract 

€scription. This explains in part their simi- 
arity as demonstrated in Results a and b. 

A major difference between behavioral 
adjustment and psychopathology, however, 
Which may partly explain the superiority of 
behavioral adjustment in relation to Results 
c, d, and e, is that psychopathology assess- 
Ment has no “top.” Psychopathology scales 
Tange from the presence of symptoms to their 
absence, Psychopathology does not 80 be- 
Yond the absence of symptoms, i.e., two pa- 
tients who show no delusions, thought disor- 
anization, etc., may be very different people. 

ne may be friendly and out-going While the 
pther may be reserved and withdrawn. Be- 

avioral adjustment, on the other hand, ex- 
ends the assessment into measuring both the 
gree of positive as well as negative be- 
‘aviors, 
ane analyses of the relationships of psy- 
pathology and behavioral adjustment to 
SUch “external” criteria as the length of hos- 
Pitalization (indirectly a measure of the se- 
Sad of psychiatric condition), readiness for 
“ischarge (Result d), and level of social ad- 
austment three months after discharge (Re- 
TAA revealed that an assessment o = 
. Onal psychopathology sympto 
significantly related S of these external 
criteria, Yet, in most psychiatric hospitals, 
= “improved” patient is the patient whose 
Ymptoms have cleared even though such im- 
rovement may not be related to how well 
the Patient handles his life after he leaves 
the hospital. The present study 1s limited y 
tie inclusion of only functional psychotic pa 
nts and by the choice of only those psycho- 


pathology symptoms which were found to be 
acceptably reliable in an earlier study. Never- 
theless, the present study would seem to raise 
some serious doubts as to the usefulness of 
psychopathology as a meaningful criterion of 
improvement in relation to other external cri- 
teria of adjustment. The assessment of be- 
havioral adjustment as a measure of improve- 
ment would seem to offer a more promising 
approach. As was seen in Result c, patients 
often show a significant decrease in psycho- 
pathology without developing a sufficiently 
high level of behavioral adjustment to war- 
rant discharge. The relative absence of psy- 
chopathology, then, does not necessarily mean 
that the patient is an adequate social indi- 
vidual. On the other hand, many individuals 
with rather extensive psychopathology are 
able to handle themselves quite adequately in 
everyday social situations. 

It is of more than historical interest to 
note that the era of “moral” treatment in 
the early 19th century resulted in over 75% 
of first admission psychiatric patients released 
as cured or improved, and over 50% of these 
patients never relapsing up to 36 to 60 years 
following release (Bockoven, 1956). These re- 
sults, which would be looked upon with pride 
by most psychiatric hospitals today, occurred 
before the advent of well defined systems 
of psychopathology, and certainly before the 
psychotic process was looked upon as a dis- 
ease entity. Bockoven (1956) concludes that 
these earlier recovery rates were not a result 
of a given treatment but a result of the non- 
obstruction of the natural course of mental 
illness. Recovery Occurs when patients are 
treated as human beings, and, “The moral 


therapist acted toward his patients as if they 
in impressing on pa- 


were mentally well . . - 
tients the idea that a change to more accept- 


able behavior was expected” (Bockoven, 1956, 
pp. 302-303). Clearly an emphasis was placed 
on behavior; and consequently, as Bockoven 
suggests, this early approach to treatment of 
mental illness must seem naive and super- 
ficial to modern dynamic psychiatry. The 
efforts of many 20th century psychiatrists, 
however, to establish mental illness as a dis- 
ease entity and to bring this field closer to 
medicine probably resulted, until recently, in 
an increased psychological distance from the 
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patient with consequent neglect of him as a 
human being. i 


Conclusions 


1. Measures of behavioral adjustment and 
psychopathology are significantly related, 
warranting the use of both as measures of 
improvement in mental illness. 

2. Behavioral adjustment appears to be 
More sensitive to “patients ready for dis- 
charge,” in predicting length of hospital stay 
and in predicting the level of posthospital 
adjustment, than Psychopathology. The lack 
of any significant relationship between psy- 
chopathology assessment and these “external” 


criteria would seem to raise some serious 
doubts as to the usefulness of psychopathol- 
ogy as a socially meaningful criterion of im- 
provement in functionally psychotic patients. 
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INVENTORY AS A PREDICTOR OF 
ADJUSTMENT 
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The Self-Activity Inventory (SAI) devel- 
oped by Philip Worchel (1957) for the U. S. 
Air Force was designed as a psychiatric 
screening device as well as to aid in under- 
standing self-concept variables. The SAI was 
originally devised to test the susceptibility to 
failure of pilot candidates under conditions 
of military stress. Subsequently, some SAI 
variables have been shown to be related to 
decrements in performance under stress as 
applied in the laboratory (Cawthon, Old- 
ae & Young, 1957; Miller & Worchel, 
957); 

Moreover, the SAI has been utilized in sev- 
eral investigations with both males and fe- 
Males (Cawthon et al, 1957; Miller & 
Worchel, 1957; Wilkinson, 1956; Young, 
1956), but previous validation studies were 
conducted with males only. Because some of 
the above studies, and others by Witkin 
(1954), revealed interactions between sex and 
Other variables as well as actual sex differ- 
ences, the necessity for additional validation 
which would take into account the sex vari- 
able was indicated. 

The present study was undertaken to ex- 
amine relationships between self-concept vari- 
ables as measured by the SAI and. qHtenos 
Variables consisting of group-rankings ani 
Self-rankings of personal adjustment, and to 
Mvestigate possible sex differences among 


these variables. 


Method 

Population. The population consisted of 50 
emale and 44 male students. Each subject 
ad resided in his or her fraternity or sorority 
ouse for at least five months. It was assumed 
that each was well acquainte 


d with all other 


students in the group due to the intimate con- 
tact provided by group activities and general 
proximity. The participating college students 
were no longer living in their family groups 
but were required to accept new forms of 
discipline and authority relationships, to form 
new positive identifications in a context dif- 
ferent from that of the family, and to forego 
narcissistic need for self-gratification in favor 
of group standards and goals. These are cri- 
teria of personal adjustment mentioned by 
Worchel (1957) in the rationale of the SAT. 

Procedure. Identical procedures were fol- 
lowed in collecting data for males and fe- 
males. A like-sex experimenter worked with 
each group. All subjects were given the SAT 
before being asked to perform the ranking 
procedure. 

Description of the SAI, The SAT is a self- 
rating scale consisting of 54 statements de- 
scribing responses of hostility, achievement, 
sex, and dependency in particular situations. 
The scale was reproduced in two identical 
forms for males and females, except that per- 
sonal pronouns appeared in the appropriate 
gender on each form. The subject makes three 
ratings on a five-point scale for each item, ac- 
cording to the following scheme which ap- 
pears as three columns on the test blank: “T 
am a person who... ,” “I would like to be 
a person who... ,” “The average person is 
one who. . . .? Summing the ratings in each 
of the three columns yields a Self score (S), 
an Ideal Self score (I), and a score for the 
“Average Person” (A). The items are so 
worded that high scores on each of these vari- 
ables indicate a trend toward depreciation on 
the variable in question; that is, the higher a 


person’s Self score the lower is his self-esteem, 
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and similarly, the higher his Ideal-Self score 
the greater is the tendency to depreciate his 
ideal self, and so on. In addition to these 
three scores, the absolute discrepancies be- 
tween ratings can be summed across the 54 
items yielding three discrepancy scores: the 
Self-Ideal (S-I), Ideal-Average (I-A), and 
Self-Average (S-A) discrepancy scores. Abso- 
lute discrepancy scores are used because alge- 
braic discrepancy scores derived from this in- 
strument have mathematical properties which 
severely limit their usefulness (Worchel, 
1956). 

Description of the ranking procedure. Fol- 
lowing completion of the SAI, each subject 
was given a list of members in his organiza- 
tion and asked to rank each individual in the 
group, including himself, on “personal adjust- 
ment.” The technique was similar to that 
used by Holtzman (1950a; 1950b), and 
Calvin and Holtzman (1953). 

Personal adjustment was defined for the 
subjects as follows: 


An ideal personal adjustment by which you might 
judge would be the person who is free from emo- 
tional problems, who handles personal problems well 
and who rarely shows signs of excessive worry or 


Table 1 


Correlations Among Self Rank, Group Rank, 
and SAT Scores 


Boys Girls 
(V=44) (NV = 50) 
Rating SAI A P 
GR X Self 
2 —.15 = 
GR X Ideal = 04 =u 
GR X Average —.00 — 22 
GR XSI SAL Zi 
GR X S-A ‘05 vi 
GR XLA ~B ~07 
SR X Self 
AT 

SR X Ideal 16 2 
SR X Average 10 ‘09 
SR XSI Age "3 
SR XSA —.06 — 03 
SR XLA ‘18 arn 
SR-GR X Self —.30** ~15 
SR-GR Sor eC. ae 
SR XGR 2 21 


* Significant at the .05 level of confid 
** Significant at the {01 level of confidence, 
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anxiety. The person functions with a minimal amount 
of conflict and tension in relation to the rest of the 
group and has harmonious interpersonal relation- 
ships. This person seems to be basically happy and 
is liked by others. 


This description of personal adjustment spe- 
cifically mentions factors related to both per- 
sonal adjustment and to interpersonal or 
group adjustment. 

The group-ranking score for each individual 
on personal adjustment was the mean of indi- 
vidual ranks assigned to a person by his as- 
sociates. The group-ranking for a member 
thus represented the consensus of his associ- 
ates. The self-ranking represented an indi- 
vidual’s opinion of himself on the adjust- 
ment variable. Thus, two independent esti- 
mates of personal adjustment were obtained. 
A high numerical rank in both instances is 
depreciating, while a low numerical rank is 
enhancing. In addition, the absolute differ- 
ence between group rank (GR) and self rank 
(SR) provided self-group rank (SR-GR) dis- 
crepancy scores. The use of the absolute dif- 
ference score (SR-GR) was justified because 
in this study it is assumed that personal ad- 
justment is in part a function of divergences 
between self and group evaluations of the in- 
dividual. Thus the magnitude of discrepancy; 
rather than direction, is the important con- 
sideration. 


Results and Discussion 


Correlations of SAI variables with self and 
group ranks are presented in Table 1. 

Examination of Table 1 indicates that 
group rank did not correlate significantly with 
any SAI variables. Self rank (SR) and the 
discrepancy between self and group rank 
(SR-GR) were significantly correlated only 
with the S and S-I scores from the SAI. Such 
significant relationships were present more 
frequently for men. However, Fisher’s Z 
transformation applied to pairs of correla- 
tions for males and females revealed that 
none of the scores was significantly different. 

Thus attempts to validate the SAI as 2 
Predictor of adjustment were uniformly un- 
Successful under the conditions of this study- 
The most meaningful and reliable criterion 
of adjustment (GR) showed no significant 
relationship with the SAI scores, nor any pro- 
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nounced trends in this direction. This find- 
ing points to the limitations of the SAI when 
used for this purpose. 

Since SR and S are two independent esti- 
mates of presumably similar aspects of a per- 
son’s self-concept, a positive correlation be- 
tween these two variables was expected. This 
anticipated relationship was obtained with a 
significance level of .01 for males. The .27 
value of r for females very closely approxi- 
mates the .28 required for a significant corre- 
lation at the .05 level of confidence with 48 
df. It was not surprising the S-I was also sig- 
nificantly correlated with SR, since S and S-I 
were not derived independently. This relation- 
ship holds at the .01 level for males and .05 
level for females. 

SR and GR correlated .22 and .21 for 
males and females, respectively. There ap- 
Pears to be little relationship between how 
the individual views himself and the group 
Consensus of him on personal adjustment. It 
is also interesting to note that the groups of 
both sexes ranked the large majority of indi- 
viduals lower (less well-adjusted) than these 
Persons ranked themselves. In other words, 
individuals and groups in this college popula- 
tion did not agree on the degree of adjust- 
Ment of the individuals, and a prime source 
Of this disagreement arose from the fact that 
Most subjects saw themselves as better ad- 
ac than did the gon 

robably the most striking 3 
Study, edna center around the ahr 
Ships between the SR-GR scores and the 
and S-I variables. The value — .39 was ob- 
tained between the S and SR-GR scores for 
males. This negative relationship et 
that if the individual, on the SAI, tends z 
express freely what one may term Ti uf 

isapproved feelings and behavior, his Ju a 
Ment of his personal adjustment tends to ‘ 
Similar to the judgment of the gt 
versely, if he denies such feelings an a 

avior, his judgment tends to disagree. p x 

e group consensus. It may be that this 7 
nial is one factor that the individuals in the 
group use in making global evaluations of 
adjustment. However, this inference JS tem- 
Pered by the fact that the corresponding cor- 
relation for females was not significantly dif- 


erent from zero, 


findings of this 


Significantly negative correlations between 
SR-GR and S-I of —.51 and —.39 were ob- 
tained for males and females, respectively. 
Thus a small self-ideal discrepancy is asso- 
ciated with a large divergence between self 
and group judgments of adjustment and vice 
versa. At first glance one might conclude that 
this result casts some doubt on the conten- 
tions of many “self” theorists (Lecky, 1951; 
Rogers, 1951; Snygg & Combs, 1949) that 
self-ideal congruence is positively associated 
with adjustment. It should be remembered 
that whereas self-ideal discrepancy is a meas- 
ure of discrepancy between two aspects of the 
individual’s self-perception, SR-GR is a meas- 
ure of discrepancy between the individual’s 
self-perception and the perception of the in- 
dividual by others. A relatively large or small 
self-ideal discrepancy was found to be asso- 
ciated with disagreement, regardless of direc- 
tion, between the group and individual esti- 
mates of adjustment. Thus a person with a 
small self-ideal discrepancy tends to rank 
himself either considerably above or below 
the group rank for himself. On the other 
hand, the individual who is more openly dis- 
satisfied with himself (large self-ideal dis- 
crepancy) tends to give himself a ranking on 
adjustment appreciably more in accord with 
that of the group. 


Summary and Conclusions 


In attempting to assess the validity of 
the Self-Activity Inventory with a mixed sex 
population, all resident members of a sorority 
and a fraternity were administered the SAI 
and asked to rank themselves, along with all 
members of their respective groups, on “per- 
sonal adjustment.” Scores were obtained for 
each subject on six variables from the SAT 
and were correlated separately for each sex 
with self rank and with pooled group rank. 
Self scores and Self-ideal discrepancy scores 
were correlated with a discrepancy score con- 
sisting of the absolute difference between self 
and pooled group ranking. 

The results indicated that SAI scores were 
not related to the major criterion of adjust- 
ment used in this study, namely, pooled group 
rank. There were no significant differences in 
the magnitudes of the correlations for the 
sexes between SAI scores and either pooled 
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group rankings or the self-rank group-rank 
discrepancy scores. Under the conditions of 
this study the validity of the SAI proved to 
be markedly limited. 

The most provocative finding showed that 
a relatively large or small self-ideal discrep- 
ancy is significantly associated with disagree- 
ment, regardless of direction, between the 
group and individual estimates of adjustment. 
The results also suggested that the individual 
who tends to give free expression to self- 
depreciative attitudes on the SAI is more 
likely to agree with the group judgment of 
his personal adjustment than one who tends 
to deny such attitudes. In general, there was 
little relationship between self and group 
ranks of the individual’s adjustment. How- 
ever, inspection revealed that most people 
ranked themselves above the group evalua- 
tion, i.e., more well-adjusted. 
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THE EFFECTIVENESS OF CLINICIANS’ JUDGMENTS: 


THE DIAGNOSIS OF ORGANIC BRAIN DAMAGE FROM 
THE BENDER-GESTALT TEST* 


LEWIS R. GOLDBERG ° 
University of Michigan 


One of the most penetrating criticisms of 
Previous attempts at assessing clinical judg- 
Ments has been that the experimental predic- 
tions asked of the clinician differed in class 
or in kind from those made in his day-to-day 
Practice, More specifically, the clinician often 
felt that the prediction of success at flight 
school (Holtzman & Sells, 1954), compe- 
tency in clinical psychology (Kelly & Fiske, 
1951), or even outcome of psychotherapy 

Barron, 1953), called for a range of infer- 
ences beyond those usually demanded of him. 
Some clinicians deny making predictions and, 
Instead, characterize their usual work in terms 
of “Personality description,” “diagnosis,” “dy- 
namic formulations,” or ‘understanding the 
Patient.” Seen in this light, a good many of 
the published studies of the clinician’s effec- 
tiveness can be dismissed as irrelevant by 
Practicing clinicians who see (hem pri- 
marily as diagnosticians or therapists. 

Te eliminate ihes objections and thereby 
Place clinicians in their best light, clinical as- 
Sessment must: (a) involve problems typi- 
cally encountered by the practicing clinician 

for example, diagnostic judgments of ETIA 
Psychiatric referrals), (b) allow the cunis 
to use his favorite techniques (be they tesis; 
interviews, case history material, reports int 
Other services, etc.) in his favorite manner e 
Utilizing them, and then (c) independently 
Validate his conclusions against evidence ac- 


hospital and 
University of 
d criticisms of 


S Paper, 
? Now at Stanford University: 
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ceptable to science as a whole; moreover, this 
entire procedure should be compared with 
similar judgments made by nonpsychologists 
(for example, clerical help). 

Once one has established the kinds of judg- 
ments which clinicians tend to make more 
validly than less-trained personnel, then the 
assessment process can be analyzed segmen- 
tally to see where and how this increased ac- 
curacy comes about. This would involve the 
same considerations mentioned above, with 
one important difference: now the clinician 
would be restricted to one specific instrument 
or one assessment technique. At this stage 
one finds many studies aimed at validating a 
specific technique, yet very rarely do they 
attempt to approximate the criteria already 
considered. For this reason, the question of 
what each diagnostic technique contributes to 
over-all diagnostic competence lies still unan- 
swered.® 

The present paper does not concern itself 
with the value implications of what the cli- 
nician does. Only in the sense that his work 
is compared with less-trained personnel is any 
judgment made of the worth of his labors. 
Whether diagnostic work-ups utilize the cli- 
nician’s time to best advantage, whether he 
should be able to predict overt behavior, 
whether he should concentrate on research 


8 These comments circumvent two related prob- 
lems: (a) the “clinical-actuarial” controversy and 
(b) the “molar-molecular” controversy. Both issues 
lend themselves to parallel research within the frame- 
work mentioned above. For example, diagnoses ar- 
rived at actuarially could be compared with those of 
the clinician and the nonpsychologist. And, diag- 
noses made, using all the clinician’s techniques, could 
be compared with ones made using a portion of 
these techniques or just one “favorite” technique. 
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and/or therapy—all such questions are 
omitted here. The assumption has been made 
that clinicians spend a good deal of their 
time in diagnostic testing, and the question 
asked here is, “how good a job are they 
r ” 

a experimental answer to this last ques- 
tion hinges on two ancillary ones: who is to 
be called a clinician, and what is the nature 
of the independent evidence to test his judg- 
ments. The frequent criticism heard when 
groups of clinicians “fail” in some experi- 
mental study is that they were not “expert” 
enough or that they were essentially “acade- 
micians.” Moreover, the criteria typically uti- 
lized in studies of this kind are all too often 
dubious in nature. Even the broad classifica- 
tions “psychotic,” “neurotic,” “character dis- 
order,” and “normal”—much less the more 
homogeneous nosological categories such as 
“paranoid schizophrenia,” “obsessive-compul- 
sive neurosis,” etc.—have no commonly ac- 
cepted operational definitions, For this rea- 
son, it is typical to accept as a criterion 
either the consensus of many (the majority 
of whom could be in error) or the judgment 
of an established few (typically Psychiatrists, 
who are usually Tesponsible for the diagnostic 
referral to the clinical Psychologist in the first 
place). 


In this Paper, which reports the first of a 
Proposed series of a. 


tice, the major concern 


nosological Category chose: 
“organic brain damage, 
its inherent criterion for 
definition; namely, 
of a competent ne 
nicians assessed in 
rently practicing 


n for this study was 
cortical,” because of 
ultimate operational 
the independent diagnosis 
urological team.4 The cli- 
cluded those who were cur- 
as diagnosticians (either 
4 This statement is n 


examining 
any implica- 
and amount of 
nce performance 
if a neurological 
extremes of the 
serve as logical 
gical techniques, 


the brain microscopically, Nor is there 
tion that localization, chronicity, 
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staff or trainees) at a large VA hospital, and 
their diagnostic performance was compared 
with that of nonpsychologists (hospital secre- 
taries). This study was aimed at the second 
stage of a total assessment project, an ap- 
praisal of the validity of a specific diagnostic 
instrument in the hands of practicing cli- 
nicians. Since the Bender Visual-Motor Ge- 
stalt Test is the most widely used test for or- 
ganic brain damage at the installation under 
consideration (and perhaps at many other 
installations), this instrument was chosen as 
the technique in question. 


Procedure 


Protocols of Bender-Gestalt tests were ran- 
domly selected from the files of a VA general 
medical and surgical hospital. Of these proto- 
cols, those from the first 15 patients who ha 
been diagnosed by independent neurologica 
examination as showing clear-cut evidence 0 
cortical impairment were selected to repre- 
sent patients manifesting organic brain dam- 
age (hereafter termed organics). As the non- 
organic control group (hereafter termed non- 
organics) the protocols of the first 15 patients 
from psychiatric wards were selected wea 
(a) psychiatric diagnoses were clearly agree d 
upon, (b) no symptoms usually ae 
with organic brain damage were repone 
(c) no record of cerebral trauma was aom 2 
and (d) any routine examination by t i 
neurological staff was negative to cortical E 
pairment. These latter psychiatric patien 3 
were all fairly recent admissions to the hos 
pital at the time they were tested and in E 
eral could be characterized as displaying acu 1 
rather than chronic symptomatology. Table 
summarizes certain descriptive variables for 
these 30 patients. , 

The 30 Bender protocols were divided int? 
three groups of 10 each, such that in weet, 
there were 2 organics and 8 nonorganics, } 
Group II there were 5 of each, and in GrouP 
III there were 8 organics and 2 nonorganic® 
This was done so as to be able to oh aac PP 
the relationship between frequency of occu 
Fence of a diagnostic entity (base-rate) a” 4 
accuracy of its diagnosis; also, this allowe 
the work for each clinician to be broken dow? 
into more convenient sections, All proton 
were assigned a code number which Wê 
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Table 1 


Description of Patient Populations 


Organics 


(N = 15; Mean age = 38; Age range = 24-61) 


Nonorganics 
(N = 15; Mean age = 32; 
Age range = 23-54) 


Symptomatology Final Psychiatric 


Etiology Localization 

(where available) V (where available) N (where available) V Diagnoses N 
Trauma 7 Rt.cerebralhemisphere 1 Convulsions 4 Paranoid schizophrenia 4 
Tumor 3 Lt. temporal lobe 1 Death 3 Catatonic schizophrenia 1 
Multiple sclerosis 2 Rt. parietal lobe 1 Chronic brain Manic-depressive psychosis 1 
hrombosis 1 Rt.frontparietallobe 1 syndrome 1 Character disorder 4 
Alvheimer’s disease 1 Rt. carotid artery 1 Hemiparesis 1 Conversion reaction 2 
Hemiplegia, spastic 1 Anxiety neurosis 2 

Headaches Obsessive-compulsive 1 


neurosis 


Printed on cardboard and stapled over the 
Patient’s name, thus removing this identifying 
data. On the other hand, all descriptions of 
how the patient actually drew the Bender de- 
Signs (i.e., arrows, circles, short notes, etc.) 
Were left on the protocols. 

Only the actual reproductions of the Bender 
designs were used in this study, since uniform 
elaborations and free associations were not 
available for all the patients. i 

Table 2 gives a breakdown of some vari- 
ables concerning the judges who participated 
Ìn this project. All of the psychologists were 
actively engaged in diagnostic evaluations at 

e time the study was conducted, although 

€y varied both in their general diagnostic 

esting experience, as well as in their par- 
ticular experience with the Bender. Many 
Used the test almost routinely as part of their 
Psychological examinations of referred pa- 
tients, while a few used it only rarely. With- 
Put exception, the nonprofessional judges had 
ad no contact with the technique. ; 
Each judge was given the three packets o 
Protocols, one packet at a time in random 
er. Directions were essentially as follows 


Or all participants: 


diaa will be given phe 
ic impressions. For 

have been divided into 3 groups of 10 each. Please 
sige each Bender individually, using any A = 
et normally apply to such a task. Take a 
you want, and feel free to utilize any mer 
S (ie, compass, protractor, ruler, etc.) n 
feel will increase your diagnostic accuracy. 


10 
Ord 


rotocols for your 
convenience they 


Please do the very best job you possibly can.5 Re- 
cord your judgments on the face-sheet attached to 


each packet. 

This face-sheet was a mimeographed form, 
listing the patients’ code numbers in a column 
down the left-hand side of the sheet. Along 
the top of the sheet were column headings 
Organic and Nonorganic, as well as a confi- 


Table 2 
Description of Participating Judges 


Approximate 
Experience 
with the 
Level of Bender 
Mean Training in 
Group N Age Psychology Mean Range 
Psychology 4 35 Ph.D.plus 6yrs. 49 yrs 
staff 4-10 yrs. 
experience 
Psychology 10 27 M.A.plus 3yrs. 1-4 yrs 
trainees 1-4 yrs. 
experience 
Nonpsychol- 8 25 None 0 None 
ogists 


5 To increase the judges’ involvement in this diag- 
nostic task, a bottle of Scotch was offered to the 
judge who performed most accurately. It was gen- 
erally felt that all of the judges “tried their best.” 
Although the judges spent only 15 to 30 minutes 
diagnosing all 30 patients, in general they expressed 
their impressions that they had been as careful in 
these diagnoses as they would be typically in their 
regular professional evaluations. 
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Table 3 
Diagnostic Accuracy by Groups of Judges 


Number of 
Judges 
Differing 
Significantly 
Mean from Chance 
KJ (50%) at the 
Group N Correct Range -05 Level 
Psychology q 3 " 
staff 4 65%* 60-70% 1 (25%) 
Psychology feu 
eae 10 70%" 60-77% 6 (60%) 
Nonpsychol- z u 
ee 8 67%* 57-73% 5 (62.5%) 
All groups 22 68% 57-77% 12 (54.5%) 


a All mean differences between groups are nonsignificant. 


dence rating scale labeled Positive 
certain; Think so; Maybe; and B 
Instructions on the form were to 
most appropriate diagnostic descr 
each patient and also to indicate 
gree of confidence in each of these j 
Thus, each participant made one di 
diagnostic judgment and then qua 
a five-point scale of confidence, 
For the nonprofessional Participants, the 
directions were amplified slightly. Since they 
had no basis at all for their judgments, they 
were administered the Bender as a patient 


would have received it. Then, they were given 
the following directions: 


ly; Fairly 
lind guess. 
check the 
iption for 
one’s de- 
udgments. 
chotomous 
lified it on 


Then followed the sam 
psychologists. 

After the 22 judges had co 
nostic task, the Bender re 
scored by the Pascal-Suttell Objective Index 
(Pascal & Suttell, 195 1), for comparison pur- 
poses with the clinical judgments, 


e directions given the 


mpleted the diag- 
productions were 


The author wishes to 
Michigan State University fi 
Bender protocols. 


thank Ronald Ribler of 
or his help in Scoring the 
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Results 
Interjudge Analysis 


The most striking finding of this study is 
the complete overlap between groups of 
judges on diagnostic accuracy (see Table 3). 
Staff psychologists, psychology trainees, and 
nonprofessional persons did not differ from 
each other in their ability to differentiate or- 
ganic from nonorganic patients by means of 
their Bender protocols. The judges’ degree 
of successful diagnoses ranged from 57% to 
77%, with six judges differing at the .01 level 
and six more at the .05 level from statistical 
chance (50%). The remaining ten judges did 
not differ in their diagnostic accuracy from 
that attributable to chance alone. 

While the Pascal-Suttell Objective Index 
(1951) was developed to help differentiate 
psychotic from neurotic populations, it has 
been used for the diagnosis of organics (Bow- 
land & Deabler, 1956). Cutting scores for 
this use of the index vary, and extensive 
normative data is as yet unavailable. If a Z 
score of 100 is used to separate the groups; 
the index accurately diagnoses 63% of the 
patients in this study (Fisher’s Exact: p7 
.04). When the cutting score is lowered to 
90, the percentage of successful diagnoses a 
creases to 67% (p = .01). The optimum oe 
ting score for this population seems to í 
around 80, at which point the index se 
noses with 80% accuracy (p < .005). As th 
cutting point is lowered below this, petro 
slowly falls away (77%, 73%, and 70% 10% 
Z cutting points of 70, 60, and 50, respec 
tively); at a cutting score of 40 or below; 
only chance results occur. ae 

To check on group differences in interjudg” 
agreement, the percentage of agreement oh 
each group of judges was computed for sae 
patient. The average percentage of agreemen 
over all 30 patients, for each group of judges, 
ranged from 78% to 85% (chance would Pa 
dict 50%), with no statistically significa: 
intergroup differences. eae 

Although the groups appeared quite mee 
with respect to diagnostic accuracy ce A 
terjudge agreement, there were large di E 
ences between the groups in the amount oi 
confidence they placed in their judgmen i 
(Kruskal-Wallis H test: p < .01), The non 
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Professional judges—with no training or ex- 
perience in Bender interpretation (and there- 
fore no apparent reason for developing con- 
fidence in the technique)—were, as a group, 
much more confident in their judgments than 
Were either the staff or the trainees. And, the 
trainees displayed more confidence in their 
diagnoses than the staff. The results present 
the surprising paradox of an inverse relation- 
ship between the amount of experience with 
the Bender and the degree of confidence 
Placed in diagnoses made from it. Moreover, 
there was no relationship between individual 
diagnostic accuracy and degree of confidence! 

To test whether the reduced confidence ex- 
hibited by the more sophisticated judges was 
the result of their finer discrimination be- 
tween the easier and the more difficult judg- 
Ments (with the more difficult ones being 
‘ated with less confidence), the average de- 
Sree of confidence for each judge was com- 
Puted for those cases he diagnosed correctly 
and again for those cases when he misdiag- 
nosed the patient. The difference between 

ese two averages (hereafter termed the in- 
ex of discrimination), when computed for 


ĉach group of judges, was found to show no 


*'8nificant intergroup differences. In general, 
Judges were about as confident on cases they 

'sdiagnosed as they were on those they diag- 
Nosed correctly. When the index of discrimi- 
“ation was used as the basis for ranking the 
Judges, there was found to be no relationship 

tween this measure and either total degree 
of Confidence or total diagnostic accuracy. 
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A further measure was developed as an in- 
dex of clinical judgment,’ under the assump- 
tion that a misdiagnosis which had been given 
with little confidence should not count as 
heavily against the clinician as one which 
was given with great confidence. An index 
was constructed in the following manner: for 
each correct diagnosis qualified by more than 
his median degree of confidence, each judge 
was given two points; for each correct diag- 
nosis given with less than his median degree 
of confidence, one point; for each misdiag- 
nosis with greater than median confidence, 
minus two points; for each misdiagnosis 
qualified by less than median confidence, 
minus one point. When total scores were 
computed for each judge, analysis showed no 
differences between the psychologists, trainees, 
and the nonprofessional judges on this meas- 
ure of clinical judgment. 

An analysis was made of the judges’ tend- 
encies to over-call or under-call organicity in 
the population they were diagnosing. The 
trainees as a group made the most “organic” 
diagnoses, 13.5 per judge, and they were the 
nearest to judging the actual number of or- 
ganics in the sample. The nonprofessionals 
made the least such diagnoses, only 8.5 per 
judge. These differences almost approach sta- 
tistical significance (Kruskal-Wallis H: p < 
10), but there was zo relationship between 
the number of patients called organic and 
diagnostic accuracy. A measure of the dis- 


7 Suggested by Philip A. Smith of the Ann Arbor 
VA Hospital. 


Table 4 
Performance of the Three Groups of Judges on Some Selected Indices 
Perform 
‘dee Degree Index of Number Index of 
PR, of Confi- Discrimi- called Clinical 
a Average % dences? nation® Organic Judgment? 
roup 
Psychology staff 78% is a as on 
sychology trainees 85% 31 11 8.5 18.8 
Onpsychologists 85% ; à ; i 
Totals 84% 2.6 1.1 11.1 19.1 


he 
“'enifcan 
Scored 0 for “blind guess"; “maybe"’ 
guess"; 1 for "may r 
a gored by subtracting the confidence score on 
a pbe.actual number of organics was 15. 
or method of scoring see text. 


ignificant at the .01 level (Kruskal-Wallis H test); all other diff $ 
Intergroup differences in degree of confidence signific: )i Frencena 


; 2 for “think so"; 3 for “fairly certain’’; and 4 for “positive.” 
misdiagnoses from that on correct diagnoses. 
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Table 5 


Group Performance as a Function of Differing Organic Base-Rates* 


Number Index ¢ 
jagnosti j 3 iscrimi- led Clinical 
Diagnostic Interjudge Confi Discrimi cal | 
Group Acseneey Agreement dence nation Organic Judgment 

Group I (2 organic; 8 nonorganic) a 

Psychology staff 72% 78% 2.2 2 ed i 

Psychology trainees 62% 84 40 2.3 p 204 9.5 

Nonpsychologists 78% 88% 3.1 21 x 

Total 70% 84% 2.6° 3 2.6 7.0 
Group II (5 of each) 7 

Psychology staff 57% 78% 2.1 5 i. 72 

Psychology trainees 73% 81% 2.5 —.2 Po 59 

Nonpsychologists 68%» 80% 3.1 2 j 

.0 

Total 68% 80% 2.6° a 3.7 6 
Group III (8 organic; 2 nonorganic) i 

Psychology staff 65% 80% 2.0 # FA i's 

Psychology trainees 75% 89% 2.6 A 5; i 34 

Nonpsychologists 56%» 89% 3A 2 3.5 

2 
Total 66% 87% 2.7¢ r) 4.8 6 


$ For explanation of indices, 
b Differences among nonpsy 
variance). 

$ Differences significant at the -01 level (Friedman). 

4 Differences significant at the .05 level (Friedman). 

° Differences between groups significant at the .05 level fi 
Note.—All other differences nonsignificant. 


see Table 4 or text, 
chologists at the three base-ra 


crepancy between the number of organics 
called and the actual number in the sample 
Was computed for each group; neither this 
measure nor the gross number of organics 
called was related to any of the previously 
reported indices. Table 4 summarizes the 
findings on these various measures, 

Since the original material presented to the 
judges consisted of three packets, each con- 
taining different Percentages of organic pa- 
tients, the data could be reanalyzed to in- 
vestigate base-rate differences on the vari- 
ables already considered. In this respect, each 
packet can be thought of as a Separate study, 
each comparable to one conducted at a dif. 
ferent type of installation (for example, a 
GMS hospital, an NP hospital, a home for 
mentally deficients, etc.). All of the previ- 
ously reported indices (accuracy, interjudge 
agreement, degree of confidence, discrimina- 
tion, clinical judgment, and number of pa- 
tients called organic) were computed for each 


i er" iance). 
or each base rate (Kruskal-Wallis one-way analysis of varia 


is of 
P y alysis 0 
tes significant at the .05 level (Friedman two-way analy 


: t 
group of judges for each of the three die 
organic base-rates. Table 5 summarizes 
results. i a 

The Friedman two-way analysis of TA 
ance (nonparametric) was run to test di A 
ences attributable to the differing base-ra oa 
The only statistically significant dieren d 
uncovered were on the “diagnostic accura 
and “number called organic” indices. a 
nonprofessionals were significantly Lame E 
curate in their diagnoses as the numba piy 
organics in the sample decreased (pro r 
because of their consistent tendency to ae a 
most sparing in their use of the ee 
“organic”). All groups called more ee ia 
organic as the actual base-rates we os i 
the sample increased (although in me theif 
of the staff judges, the small size o 
group prevented statistical sicmapactes a 

The Kruskal-Wallis one-way analysi th 
variance (nonparametric) was carried oe 
test if any of the differences between me® 


| 


| 


-= 
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group scores, at each base-rate, were statisti- 
cally significant. Just as in the case of the 
over-all analysis, the three groups of judges 
were found to differ significantly only in their 
degree of confidence. 


Inter patient Analysis 


Sometimes the “majority opinion” of a 
group is more accurate than any of the opin- 
tons of its individual members. To check on 
this, a “group” diagnosis, generated by com- 
bining the diagnoses made by all of the 22 
Judges, was examined for each patient. The 
amount of agreement between judges ranged 
from complete agreement on one patient (a 
manic-depressive psychotic, correctly diag- 
Nosed by everyone as nonorganic) to a com- 
Plete 11-11 split in opinion on two patients 
(both organics). There was less than 75% 
agreement on 8 of the 30 patients. 

For those 28 patients on whom there were 
Majority” diagnoses, the group as a whole 
misdiagnosed two nonorganics (both paranoid 
Schizophrenics) and five organics (of whom 
three had symptoms which included grand 
mal Convulsions, one was a case of posttrau- 
Matic encephalopathy, and one had a deadly 
Slioblastoma multiforme). Thus, if one counts 

e evenly divided cases as errors (since no 
8toup diagnosis was generated), the group as 
a whole correctly diagnosed 70% of the pa- 
tients, a figure not significantly different from 

e mean of the individual diagnoses (687). 

Interestingly, the degree of pereema 
among the judges did not correlate signi- 
cantly with the accuracy of their combined 

lagnoses, Moreover, majority accuracy ji 
not turn out to be related to such variables 
3S the chronological age of the patien 
US nosological category. On the othe H 
Since most of the judges tended to ni 
mate the actual number of organics in the 
Sample, they tended to be most in agreement 
on patients whom they diagnosed nonorganic 
(Fisher’s Exact: p = 013). 

Certain patients must have seemed 
to diagnose than others, since there was a 
Strong relationship between the amount of 
agreement on a patient’s diagnosis and the 
total pooled confidence ratings given for this 
diagnosis (Fisher's Exact: p < 001). Sur- 


t nor to 
r hand, 


easier 


prisingly, however, the judges were just as 
confident in rating their incorrect as their 
correct diagnoses; nor were they any less con- 
fident in diagnosing organic than nonorganic 
patients. 


A Subsequent Exploration 


In the course of examining the relationship 
between diagnostic accuracy and experience 
with the Bender, it was noted that the judge 
who performed most accurately was a trainee 
who had spent considerable time (as part of 
his research for a doctoral dissertation) in 
administering, scoring, and interpreting tests 
for organic brain damage with a large group 
of brain-damaged patients. Although a staff 
judge also had considerable Bender experi- 
ence and only performed at the median level 
on this task, one might still wonder whether 
specific intensive experience with the instru- 
ment might not increase diagnostic accuracy. 
In effect, this hypothesis would imply that 
although the practicing diagnosticians were 
not more accurate than nontrained persons on 
this task, real “experts” with the Bender 
could surpass them all. 

To test this hypothesis, one of the coun- 
try’s foremost authorities on the Bender test 
was solicited to take part in this study.’ This 
judge, taking some 20 hours to complete the 
diagnostic process, did perform more accu- 
rately than anyone in the original study— 
diagnosing 83% of the patients correctly. His 
scores fell in the middle of the over-all dis- 
tribution on degree of confidence and dis- 
crimination, but he was one of the most ac- 
curate in judging the actual number of or- 
ganics in the sample. He also was at the top 
on the index of clinical judgment. 

Since his performance lends support to the 
“expert” theory on Bender diagnosis, it 
seemed legitimate to combine the scores of 
the top two diagnostic judges in this study 
into a subgroup of Bender “specialists” and 
then to reanalyze the data comparing their 
performance on all the indices with that of 
the three other groups. This analysis revealed 
no significant differences on measures other 


8 Special acknowledgment is due Max Hutt of the 
University of Michigan for the time and thought he 
invested in this phase of the study. 
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than those of accuracy and clinical judgment 
(Fisher’s Exact: p < .004), on which vari- 
ables the “specialists” were, in effect, selected. 


Discussion 


In general, the results indicate that diag- 
nostic accuracy (when using the Bender to 
diagnose organic brain damage) does not de- 
pend on experience or training in psychology 
(unless, perhaps, that training includes years 
of intensive work with the instrument in ques- 
tion). If he is not a real expert in the use of 
the Bender, a clinician will find that his secre- 
tary can probably do this particular job of 
differential diagnosis as well as himself. More- 
over, she will most likely have considerably 
more confidence in her judgments than he 
would have in his. This makes it all the more 
unfortunate that one’s degree of confidence 
bears no relationship to his diagnostic accu- 
racy on this task! 

Now these results, in themselves, may be 
embarrassing. And, when one considers the 
base-rates of organics usually encountered in 
clinical practice, one might even become 
alarmed. For in most settings the actual base- 
rate is closer to Group I (20% organics) 
than to any of the other groups in this study. 
And it is in this Group I where the nonpro- 
fessionals—by virtue of their tendency to 
label most patients nonorganic—appear most 
likely to overshadow their professional em- 
ployers in diagnostic accuracy (see Table 5). 
However, neither the nonprofessionals nor the 
group as a whole did as well as could have 
been done by merely calling all patients in 
this group “nonorganic” and thereby diagnos- 
ing with 80% accuracy. 

Before judging the Bender too harshly, 


however, the following factors should be con- 
sidered: (a) the grou 


study provided no basis f 
Bender with other tests 
damage in order to see 


or comparing the 
for organic brain 
whether the wide- 
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spread faith in this technique is indeed com- 
paratively justified; (c) it is of course pos- 
sible that other tests taken in combination 
with the Bender may permit judges to diag- 
nose more accurately; and (d) one cannot 
immediately discount the utility of the cues 
furnished by a face-to-face encounter with 
the patient, cues which were totally absent in 
this study. 

On the other hand, these results might have 
been anticipated on the basis of previous work 
in this area (Bowland & Deabler, 1956). 
For example, Pascal and Suttell (1951), 
while formulating their Objective Index to 
differentiate psychotics from neurotics, have 


this to say about the differential diagnosis of 
organics: 


The Bender-Gestalt test cannot, in the absence of 
other data, answer that question (is there cortical 
damage?) except occasionally in extreme cases which 
are also clinically apparent (p. 40). 


Performance on the Bender-Gestalt test can indi- 
cate damage to the cortex only when the damage 
shows its effect by pronounced disturbance of the 
ability to execute the test. We know that nine yen 
old children can reproduce the designs withou 
marked deviation from the stimuli. When, therefore, 
an individual is functioning at a maturational leyni 
of nine years with respect to his ability to rry 
duce the designs, so to speak, we cannot disting 
between his deviation and those of individuals a 
fering from psychogenic disorders. This fact sues 
that damage to the cortex has to be rather severe 
its effect on the functioning efficiency of an adult 3 
normal I.Q. before it can be detected by menni, 5 
performance on the Bender-Gestalt test. This ae 
also suggests that actual lesions may exist mh 
cannot, on the basis of the deviations noted by 6). 
be detected in performance on this test (pp. 62-6 


Nevertheless, since the evidence suggesi® 
the possibility that real experts in the tec a 
nique may perform with increased diagnos 
accuracy on this task, it is conceivable ee 
they might be able to communicate whater 
interpretive refinements they possess. In “1 
fect, this has been tried with the Pascal-Sutte 
Objective Index, which at its optimum ote 
ting point performed about as well as did a 
best of the individual judges. Significant 
this connection, however, is the considerab Y 
greater length of time taken by the top e 
pert in making his diagnoses as compared d 
the amount taken by any of the others, me, 
correspondingly the greater length of tim 
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needed to score records by the Pascal-Suttell 
method. Assuming that real experts—after 
considerable time and careful scrutiny—can 
slightly out-perform hospital secretaries, the 
value of this potential increment in accuracy 
must be carefully evaluated. 


Summary 


Staff psychologists, psychology trainees, and 
nonprofessional (secretarial) judges made 
diagnostic judgments from the Bender proto- 
cols of 15 organic and 15 nonorganic patients 
and then indicated their degree of confidence 
for each of their diagnoses. The three groups 
of judges did not differ in their ability to 
diagnose organic brain damage from the 
Bender, although the nonprofessionals dis- 
played considerably more confidence in their 
judgments than did either of the other groups. 
The Pascal-Suttell Objective Index approxi- 
mately equaled the clinical judgments in diag- 
Nostic accuracy, but a renowned Bender ex- 
Pert was able to better the diagnoses of the 


practicing clinicians. The group as a whole 
diagnosed above a chance level, but when the 
base-rate of organic patients typically en- 
countered in clinical practice is considered, 
the results suggest that chances for misdiag- 
nosis could be increased by utilizing the 
Bender-Gestalt test. 


Received January 14, 1958. 


REFERENCES 


Barron, F. Some test correlates of response to psy- 
chotherapy. J. consult. Psychol, 1953, 17, 235- 
241. 

Bowtanp, J. A., & Deasrer, H. L. A Bender-Gestalt 
diagnostic validity study. J. clin. Psychol., 1956, 
12, 82-84. 

Hortzman, W. H., & Serts, S. B. Prediction of fly- 
ing success by clinical analysis of test protocols. 
J. abnorm. soc. Psychol., 1954, 49, 485-490. 

Kerry, E. Lọ, & Fisxr, D. W. The prediction of 
performance in clinical psychology. Ann Arbor: 
Univer. Michigan Press, 1951. 

Pascar, G. R., & Sutrerr, BARBARA J. The Bender- 
Gestalt Test. New York: Grune & Stratton, 1951. 


Journal of Consulting Psychology 
Vol. 23, No. 1, 1959 


CHANGE IN MENTAL ABILITY AS A FUNCTION 
OF TEST ANXIETY AND TYPE OF 
MENTAL TEST? 
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Yale University 
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Zweibelson (1956) reported the results of an 
investigation of the relation between test anx- 
iety in fourth-grade children and their per- 
formance on test-like and game-like group in- 
telligence tests. The three group tests of men- 
tal ability employed in his study, the Otis 
Alpha, Otis Beta, and Davis-Eells tests, were 
described in detail with regard to items, style 
of writing, method of administration, and 
the like. Stronger relationship was found be- 
tween the Otis Alpha test (a test-like instru- 


ment) and the Test Anxiety Scale for Chil- 
dren (TASC) 27 = — -28—than between the 
Davis-Eells test ( 


a game-like instrument) and 
the TASC— = — 14. While the correlation 
between the Beta test and the TASC (— .24) 
Was not significantly different fro 
lation between the Davis 


, the Beta-TASC correlation 


m the corre- 


1 This research was Supported by a grant from the 
ic Health Service, 


1956, pp. 4-5), contend that performance on 
their test is less a function of traits like com- 
petitiveness, compulsiveness, and anxiety than 
is performance on other tests which empha- 
size reading ability and speed. Zweibelson 
found some support for their contention in 
his study in which fourth-grade pupils were 
administered the two Otis tests, the Davis- 
Eells Games, and the TASC once only. The 
Present paper throws further light on the re 
lationship between test anxiety and group 
means on these three tests of mental ab 
In addition, data are presented which Shor 
the relationship between test anxiety es 
changes in Otis Beta and Davis-Eells score 
Over an interval of two years. =. ie 

Our specific interests can be stated ae 
form of three hypotheses: First, the oe 
ence between low anxious (LA) and hig 


| 
anxious (HA) group means should be greater 


is-Eells 
on the Otis tests than on the Davis aes 
tests, the HA group obtaining lower ene 
Second, the increment in mean raw sc 


rg 
from one year to the next should be greate 


for the LA than for the HA groups on a 
Otis tests. And third, the difference in ee 
ment between the LA and HA groups ae 
be less on the Davis-Eells tests than on oe 
Otis tests. Since data for this a irs 
were available for only the Otis Beta ee 
the Otis Alpha scores could not be compar 

vith those of the Davis-Eells. 

a hires hypotheses stated above follow 
from essentially the same rationale regram 
test anxiety and test performance. Sarason, 
Davidson, Lighthall, and Waite (1958, P- 
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.test-like instrument, whereas the 8 
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109) conceptualize test anxiety as “primarily 
interfering in its effect.” Zweibelson (1956) 
qualified this conception. He interpreted his 
data as indicating that the test-anxious reac- 
tion was more interfering in performance on 
a test-like than on a game-like task. In ex- 
Ploring available data with regard to the three 
hypotheses stated above we sought further to 
extend the concept of test anxiety. For exam- 
ple we asked, in reference to Hypothesis 2. 
“Does the differential performance of high 
and low test-anxious subjects to different 
types of mental test (test- and game-like) 
hold up also for mean change over time on 
these same types of test?” Our answer as 
Stated in the second hypothesis was again a 
reflection of our assumption that test anxiety 
is interfering in its effect, but —- 
interfering with performance on test-like = 
game-like tests. In testing this hypothesis we 
Were testing whether the test-anxious reac- 
tion was interfering with improvement in per- 
formance on these two types of mental tet 
The first hypothesis, in contrast, 1S simper 
in its assumptions and follows more e 
from the implications of Zweibelson de : 
Namely, that over-all mean ee 
hese two types of test should be i oan 
as regards the high and low an wed pa 
the LA group doing significantly bet — 
edly superior to the HA on t os soma 
task, where anxiety is assumed to Deal te 
terfering. Hypothesis 3, like ae! ee “i 
Pothesis, relates to change in per a noite 
the two types of test and ee aeons 
Sumption that this change ae oups: That 
ential as regards the HA and LA gr rease sig- 
is, the scores of the HA — or ie 
nificantly less than those of t P = 
LA and HA should not be sigoltoentis H 
ferent from each other. Each of t ee 
Potheses assumes that the TASC is Ca Ee 
in discriminating the high from an b AA 
ious over a period of time up va 2 tale 
half years from the date of TASC a 


tration. 
Subjects 


Subjects were all in the same grade. ay 
two pupils were distributed equally i 


Table 1 


Sequence of Test Administrations 


Date Grade Date Grade Date Grade 


Otis Alpha Jan., 2 May, 4 
(N*=108) 1952 1954 

Otis Beta Oct, 5 Oct. © Oct. T 
(N*=92) 1954 1955 1956 

Davis-Eeels Oct., 5 Oct., 7 
(N*=92) 1954 1956 


a N here refers to the number of Ss finally selected for study 
from the total tested population. While these Ss cannot be 
considered to be a purely random sample, it is safe to say that 
the only factor limiting their number was absence from school 
on testing days. 
sex-anxiety groups (n = 23) in all but the 
first of three analyses. In that first analysis 
108 pupils, including 83 of the above-men- 
tioned 92, were distributed equally between 
the high and low anxiety groups (n = 54), 
but unequally between the two sex groups, 
boys numbering 62 (31 LA and 31 HA) and 
girls numbering 46 (23 LA and 23 HA). 
Data were available for these Ss because of 
their connection, as a part of a larger sam- 
ple, with a continuing research program. 
These data are not the result of a planned 
execution of a research design but, rather, 
result from an investigation after the fact, so 
to speak, to establish whether certain effects 
found by Zweibelson (1956) are also pres- 
ent in these data, resulting from the regular 
school testing program. 


Procedure 


The school-wide testing program had been 
carried out in the sequence shown in Table 1. 
The TASC was administered to these Ss in 
May, 1954, when they were in the fourth 
grade. Unlike Zweibelson’s study, the LA and 
HA groups in the present study were not 
taken from the extremes of the distribution of 
test anxiety scores but were grouped relative 
to their position above or below the sample 
median. Separate medians were computed for 
boys and girls. Analysis of variance designs 
were used throughout, with both between and 
within subject effects. In comparing scores of 
two different tests standard scores were com- 
puted. Analysis of gain scores in the Otis 
Beta-Davis-Eells comparison was based on 


36 F. Lighthall, B. Ruebush, S. 
the standardized differences of each individu- 
al’s raw score on the first administration of 
a test subtracted from his raw score on that 
test administered two years later. 


Results 


The first analysis, involving the TASC and 
the Otis Alpha test, showed no anxiety, sex, 
or anxiety-sex interaction effects either on 
over-all Otis Alpha means of the two ad- 
ministrations combined or on gain in mean 
from the first to the second administration. 

The second analysis, involving the TASC 
and the Otis Beta test and in which there 
was a 77% overlap with Ss employed in the 
first analysis, showed the only clearly signifi- 
cant finding (p < .01) to be a simple main 
effect of sex grouping on the over-all Beta 
mean (collapsing the three sets of scores from 
the three Beta administrations into one set 
of scores). The girls received a higher over-all 
mean than the boys. In addition, this mean 
was different for the two 
between the .10 and .20 ley 
ing poorer than the LA grou 

There was also a difference 

in the rate of gain in Beta score over the 

three years for the two an 


ye xiety groups, the 
LA gaining the more rapidly and augmenting 


anxiety groups 
el, the HA do- 
PS, as expected. 
(.10 < p < .20) 


Table 2 


Summary of Otis Beta and Davis-Eells Raw Score 
and Gain Score Analyses 
(n=23,N = 92) 


Mean 


E Mean 
quare Square 
Source df Raw Score Gain Score 
Between 3 
Anxiety 1 3,213.91** .24 
a s 1 364.57 .07 
a> 1 219.58 -00 
Tor 88 450.05 1.03 
Within 4 
Test 1 16,209.39 
y n a -00 
RSS 1 66.98 3.30* 
TSA 1 147.96 AZT 
as XS 1 151.56 .07 
TrOr 88 163.43 1.01 


*.05< b <.10. 

7 Significant b 
a Significant but trivial, sing s 
used and tests contained different numise es items Ses) 
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the difference between the HA and LA means. 
Sex was not found to affect the rate of gain 
on Beta score. 
The third analysis, with the same Ss as in 
the second, concerned the differential rela- 
tionship of test anxiety to Davis-Eells scores 
compared with Otis Beta scores. This analy- 
sis revealed a significant effect of anxiety 
level on mean mental ability score (p < .01) 
which was uncomplicated by interaction of 
test (Otis Beta or Davis-Eells) with anxiety. 
As to the change of scores on the two tests 
over two years, there was no over-all effect 
of anxiety on gain but rather an anxiety-test 
interaction effect, as hypothesized (.05 < ? 
<.10). This effect, while not robust, re- 
vealed that while the LA gained more over 
two years than HA on the Beta (test-like) 
test, the HA gained more than the LA on the 
Davis-Eells (game-like) test. The difference 
between LA and HA was more marked on the 
Beta test than on the Davis-Eells test, how- 
ever. The third analysis, including mea? 
squares for both over-all mean effects and for 
effects of change, is summarized in Table 2- 
The reader will note that the within Ss and 
between Ss error mean squares for (standard- 
ized) gain scores are of virtually equal magni- 
tude. This indicates that there is as much 
variation, on the average, from an individu- 
al’s gain on the Otis to his gain on the Davis- 
Eells as there is from one individual’s over- 
all gain to another’s over-all gain. This is i” 
contrast to the within and between erro" 
terms, also appearing in Table 2, in the analy- 
sis of raw scores combined over the two years: 
In other words, there is no correlation be 
tween gains on the Otis and gains on thé 
Davis-Eells over this two-year period, eve? 
though there is a correlation between over-4 
raw scores on the two tests as indicated bY 
the small magnitude of the within Ss error 
term for raw scores (163.43) relative to the 
comparable error term between Ss (450.05): 
Pooled within groups correlations betwee? 
Otis and Davis-Eells scores from first a” 
second administrations of the tests, respec” 
tively, are .46 and .59. 


Discussion 
The first hypothesis stands unconfirmed‘ 


over-all mean performance on the two Otis 
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tests is not found to be related to test anx- 
iety in any way different from that in which 
the over-all mean on the Davis-Eells test is 
related to test anxiety. The second hypothe- 
sis receives support from the analysis of Otis 
Beta increments over three years, but not 
from analysis of Otis Alpha increments over 
two (earlier) years. Alpha gains from the 
second to the fourth grade are not signifi- 
cantly related to (fourth grade) test anxiety 
grouping, while Beta gains from the fifth.to 
the seventh grade are somewhat (.10 < $ < 
20) related to (fourth grade) test anxiety 
grouping. The third hypothesis is confirmed. 
Furthermore, not only is the magnitude of the 
difference between the gain scores of the HA 
and LA groups less on the Davis-Eells test, 
but, in comparison to the LA, the HA show 
8reater improvement on the Davis-Eells and 
less improvement on the Otis Beta. 

Various interpretations may be offered for 
the lack of correlation between gain on the 
Otis Beta and gain on the Davis-Eells tests. 
First, it is well known that error in gant 
Scores is greater than error of measurement 
in either the first or second measurement 
taken separately. Thus, unreliability a 
appear to be suppressing the cartelation o 
tween the two gain scores. A valid objec "3 
to this argument would seem to be shat k e 
gain scores were reliable enough to yield a 
within Ss effect (test-anxiety interaclioz) e 
nificant between the .05 and .10 leve an 
therefore should be reliable enough to a a 
for correlation with each other if such ee 
tion did in fact exist. Another explanation s 
the lack of relationship between gains pi an 
two tests is that the sample employed mg 
e peculiar in this regard. While it os 
that the sample was not drawn randomly from 
an unselected group of pupils, there adie 
Mains the discrepancy between corre? ae 
46 and .59, of raw Beta and raw Devis- À 
Scores, for first and second testings on the on 
and, and the correlation between gain scores 
(zero), on the other hand. A third explanation 
for the lack of correlation, with severe p i- 
cations for psychological measurement, is that 
improvement on these two tests, the Otis 
Beta and Davis-Eells, requires quite inde- 
pendent types of growth, even though they 
both purport to measure intelligence. If this 
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is true, it lends strong support to Davis’ and 
Eells’ contention that they are tapping a dif- 
ferent domain from those measured by most 
group-administered mental tests, of which the 
Otis is in many respects representative. If 
gains on group-administered mental ability 
tests are important, and if the results pre- 
sented here on gains are at all representative, 
then the choice of which test and/or type of 
test (examination- or game-like) to employ is 
extremely important. Additional research on 
the reliability and correlates of the gain scores 
on the Otis Beta and Davis-Eells tests is 
necessary before unequivocal interpretation of 
longitudinal results with these tests is pos- 
sible. The assumption that the TASC is ef- 
fective in discriminating the high from the 
low test-anxious over a period of time up to 
two and one-half years appears to have valid 
foundation, provided that this period is be- 
tween the fourth and seventh grades. 

While the first hypothesis was not borne 
out and the second received only partial sup- 
port, it must be emphasized that the basis of 
grouping Ss in anxiety levels was their po- 
sition relative to the median and not mem- 
bership in extreme groups, as in the Zweibel- 
son study. This fact tends to point up the 
significance of the support for the third hy- 
pothesis. However, as this was an exploratory 
study, its main significance lies in revealing 
general trends and providing suggestions for 
further research. Two general trends are 
shown: (a) mental ability scores tend to 
change from fifth to seventh grade differen- 
tially for high and low test anxiety groups 
and (b) this change is related to the type of 
test used in measuring mental ability. Fur- 
ther research suggested by these results con- 
cerns (a) the interaction of grade with the 
effect of anxiety on change in mental ability 
scores (e.g., why is there no effect of anxiety 
on change from the second to the fourth 
grade when there is one from the fifth to the 
seventh grade?) and (b) the specific nature 
of the effect of different types of mental abil- 
ity test on the relation between anxiety and 
performance on these tests. For example, does 
the difference in HA and LA performance on 
the Otis Beta from that on the Davis-Eells 
test show that where no reading ability is 
needed (Davis-Eells) anxiety is not inhibitory 
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and even possibly facilitating in effect on per- 
formance? The above-mentioned trends have 
at least two implications. First, the earlier the 
anxiety level of school children can be identi- 
fied, the earlier they can be provided with a 
therapeutic program designed to help them 
recognize the interaction between their anx- 
iety and various types of situations, and to 
learn to capitalize on the (possibly) facilitat- 
ing effects of anxiety while minimizing its in- 
terfering effects. Second, the interpretation of 
change in mental ability must take into ac- 
count variations in type of measuring in- 


strument such as Zweibelson has enumerated 
(1956, Table 1). 


Summary 

Three analyses were 
available from a re 
gram. Each analysis 
performance on the 


carried out on data 
gular school testing pro- 
concerned the relation of 
Test Anxiety Scale for 
Children to performance on three mental abil- 
ity tests described and employed by Zweibel- 
son (1956). The effect of test anxiety group- 
ing (above and below median) on both over- 
all mean and change in mean over a dura- 
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tion of two years was tested with reference 
to three hypotheses: 1. The difference be- 
tween low anxious (LA) and high anxious 
(HA) over-all means should be greater on 
the Otis (test-like) tests than on the Davis- 
Eells (game-like) test. 2. The mean incre- 
ment from one year to the next should be 
greater for the LA than the HA on the Otis 
tests. 3. The difference in increment for LA 
and HA should be less on the Davis-Eells test 
than on the Otis Beta test. The first hypothe- 
sis was not supported, while the second re- 
ceived partial support. The third hypothesis 
Was supported. Implications both for practice 
and further research were discussed. 


Received January 18, 1958. 
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THE VALIDITY OF THE SPIRAL AFTEREFFECT 
AS A CLINICAL TOOL FOR DIAGNOSIS 
OF ORGANIC BRAIN PATHOLOGY * 


EMILY B. PHILBRICK 


University of California, Berkeley 


Many of the cases that are referred to the 
Psychology staff in a general hospital are 
Ones in which the neurologists wish additional 
information in their attempt to determine 
whether or not organic brain pathology exists. 
Although psychological tests such as the 
Bender-Gestalt, WAIS, and Rorschach are 
Useful in such a diagnosis, these tests are 
far from adequate (Armitage, 1946; xe 
1954). More clinical tools are vitally eede 
and so any procedure needs to be page y 
investigated that reportedly will detec 
8anic brain pathology. 

Price ad cee (1955) and Hee: 
Price, and Deabler (1957) reported i n 
96% to 98% of cases with eS prm 
Syndrome could be picked up by a ara 
medes Spiral test, while Gallese (195 ) wa ip 
the same apparatus and a somemna' na 
Procedure and sample, reported tha R 
of such cases could be correctly a 
These reports appeared to be mo n m 
aging and a cross validation study a ih 
work of Price and Deabler was p 
In addition, the spiral test was mn a apt 8 
ing most patients the Weinstein so i EA 
tal test (Weinstein & Malitz, 1954). 


ns 

1 This research was carried out at Fe unon 
Administration Hospital, San Francisco, thor wishes 
the suggestion of Jerome Fisher. The administered 
also to thank Stuart MacRobbie, win neurologic 
the sodium amytal injections and did ie Lewis A. 
classification, and Henry W. Neuman an classifica- 
Roberts, who also aided in the neurologic critically 
tion. David A. Rodgers helped by soa anuscript 
the first draft of this manuscript. Tig onal fel- 
was prepared while the author held hesodiattont of 
lowship awarded by the American ‘550 
University Women. 

The author is now at College of 
Calif, 


Marin, Kentfield, 


39 


Weinstein test presumably increases certain 
organic symptoms when diffuse brain pathol- 
ogy exists. Therefore, it seemed important to 
study its effect on the perception of the spiral 
aftereffect. 


Method 


Eighty-one patients, essentially consecutive 
admissions, from the neurology ward of this 
general hospital were given the Archimedes 
spiral aftereffect test. Only those physically 
unable to leave their beds, or with gross eye 
defects, were omitted from the testing. The 
apparatus and procedure used corresponded 
to that reported by Price and Deabler (1955). 

An electric motor commonly used for color 
mixing experiments was used to rotate a white 
8” disk on which was painted a black Archi- 
medes spiral of 920° or 24 circuits about the 
center. The apparatus was so constructed that 
the disk could be rotated in either direction. 
The disk was rotated at approximately 100 
rpm. 

The patient was seated 8 ft. from the ap- 
paratus. Testing was conducted at noon when 
natural illumination was good. The patient 
was informed that this was a special eye test. 
He was asked to keep his eyes on the center 
of the spiral and was reminded of this at in- 
tervals during the testing period. In half of 
the cases the spiral was rotated first to give a 
negative aftereffect of expansion (Spiral A), 
while in the other half the rotation was in 
the opposite direction first, giving a negative 
aftereffect of contraction (Spiral B). After 10 
seconds of rotation the patient was asked: 
“What does the line seem to be doing?” At 
the end of 30 seconds the rotation was stopped 
and the patient was asked immediately: “Now 
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what does the line seem to be doing?” The 
patient’s answer was recorded verbatim. Each 
patient was shown the spiral four times, in 
the order A-B-A-B or B-A-B-A. 

The responses were scored in two different 
ways: once following the method outlined by 
Price and Deabler (1955) and Farrett et al. 
(1957), who used half scores as well as whole 
scores, and once following Gallese (1956), 
who used only whole scores. Price and Deab- 
ler (1955) state: 


Each normal report, that is, seeing the negative 
aftereffect correctly, was scored 1. Each abnormal 
report, that is, failure to perceive the negative after- 
effect, was scored 0. Reports of aftereffect in which 
no apparent change of dimension occurred but in 
which apparent motion forward or backward was 
reported, were given a score of 4. . . . The Ss scored 
a total of 4, 3, 2, 1, or O depending on the degree 
of their perception of the aftereffect. . . . In the in- 
terests of conservatism, to give S the benefit of a 
doubtful response, fractional or half scores were 
raised to whole scores in final computation (p. 300). 


Gallese (1956) does not distinguish between 
reports of change of dimension and apparent 
motion forwards or backwards and gives a 
full score of 1 to either type of response. 
After the spiral test had been run, a Wein- 
stein amytal test (Weinstein & Malitz, 1954) 
was run on 53 of the 81 patients, and this 
was then followed by another complete pres- 
entation of the spiral aftereffect test. The 
Weinstein test is designed to diagnose diffuse 
brain pathology and consists of asking the 
Patient the same 21 questions before and 
after an injection of sodium amytal. Any 
changes in the direction of concretism, lack 
of orientation, etc. in the answers are noted. 
The hospital neurologist interested in check- 
ing this test was present throughout the spiral 
and amytal tests, and administered the drug. 
The amytal was given during a 10-minute 
period with the amount given varying in each 
case. The drug was administered until the 
patient showed signs of visual nystagmus, 
blurring of speech, drowsiness, and counting 
errors (backwards from 100 by ones), 
The exact action of sodium amytal is not 
known. One theory states it may act to in- 
hibit some enzyme system or cell metabolism, 
thus preventing the cells from functioning so 
rapidly. Unlike phenobarbital and other simi- 
lar drugs, it not only affects higher centers 
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but acts more specifically, and to a greater 
degree, on subcortical areas concerned with 
associations between cortical lobes and di- 
encephalic centers. Because of this action, 
clinical manifestations of organic damage are 
augmented, and the spiral test was rerun as 
it seemed possible that the ability to see the 
negative spiral aftereffect might be further 
impaired when organic brain pathology was 
present. 

At the time of working with these patients 
they had not yet been diagnosed as having 
an organic brain syndrome. It was not until 
all the testing had been completed that at 
least two neurologists rated each patient as 
“organic” or “nonorganic” on the basis of 
discharge summaries and total case material. 
A patient was placed in the “organic” cate- 
gory if he was considered to have organic pa- 
thology above the foramen magnum. On the 
other hand, if the neurologists considered the 
patient not to have organic pathology or to 
have organic pathology below the foramen 
magnum, he was placed in the “nonorganic 
category. There were nine cases on which 
there was not agreement, and these were not 
considered as part of the final sample. Thus 
the results were computed on a sample of 7 
cases, and on 53 cases in which amytal ha 
been given. Forty-five cases of the 72 were 
considered to be organic. These included such 
disease entities as multiple sclerosis, brain 
tumors, Parkinsonism, epilepsy, cortical atro- 
phy, etc. 

Price and Deabler (1955) and Farrett et al. 
(1957) refer to their organics as having corti- 
cal involvement. Nowhere do they state ex- 
actly what they mean by this. Since their 
sample includes cases of Parkinsonism an 
cerebral vescular accidents, and these are 
commonly not considered as usually involving 
the cortex directly, it may be inferred tha 
“cortical involvement” is used loosely to mean 
“brain involvement.” Therefore, the sample 
of organics used in this study may be con- 
sidered comparable to those in the former 
sample, with the addition of epileptics in this 
sample. 


Results 


As was previously stated, the data were 
analyzed using the scoring system reported by 
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pee and Deabler (1955) and Farrett et al. 
ie and that used by Gallese (1956). No 
Fs onale for using half scores is given by the 
cath authors. Goldstein (1948) and other 
els igators consider. that organic brain pa- 
ity ogy leads to impairment of abstract abil- 
nam a concreteness of thinking resulting. 
orice ly Price and Deabler are using this 
ed and considering the response of 
tha ge of dimension as being more abstract 
i movement forward or backward and, 
Bato the superior response.. It would seem 
törs age, IQ, etc. might be important fac- 
in rather than simply organicity, in deter- 
af aoe the verbal response. Thus the validity 
ee ee the form of response as diag- 
ecard has been checked here by scoring the 
Price s with and without this differentiation. 
ee are extremely vague 1 
thick. lescription of their method of analyzing 
Ps r data. Gallese considers scores of 0-2 as 
on and 3-4 as nonorganic. This, then, 
t e cutting point used here. Chi square was 
€ statistic used to test the significance 0 
e results, 
ihe easily be seen from the ta 
bi ts differ greatly from those 
ously by Price and Deabler and 
br able 1 gives the results followi 
Ocedure and analysis used by Price 
eabler. Under the conditions of this st 


bles, these 
reported 
Gallese. 
ng the 
and 
udy 


were is no differentiation of organics from 
organics by the spiral aftereffect test. 
t for these 


veral things probably accoun 


Table 1 
Discrimination Value of Spiral Aftereffect Tests 
sing Price and Deabler’s Scoring System 
(Before Amytal) 


Spiral Criteri 
riti l 
i Neurological Classification 


Price and Deabler 


/2 scores) Organic Nonorganic 
O; ; 
ep a 21 
- OF patients 24 
6 Of patients 53.3% 46.7% 
No 
yoreanic scores 3-4 
- of patients 13 14 
6 of patients 48.2% 51.87% 


Not, 
©—Chi square p >. 70. 
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Table 2 


Discrimination Value of Spiral Aftereffect Tests 
Using Gallese Scoring System 


(Before Amytal) 


Spiral Criterion 
Neurological Classification 
Gallese Scoring SSS 


(No 1/2 scores) Organic Nonorganic 


Organic scores 0-2 
No. of patients 9 36 


% of patients 20% 80% 
Nonorganic scores 3-4 
No. of patients 4 23 
14.8% 85.2% 


% of patients 


Note.—Chi square, p > 55. 


surprisingly discrepant results. Subjects who 
fall at extreme ends of a distribution as they 
do in the former studies (organics vs. nor- 
mals) may often be correctly diagnosed, while 
the same test may fail with individuals fall- 
ing closer to the center of the distribution. 
There are no normal cases in this study com- 
parable to those used in the former work. 


However, as Fisher, Gonda, and Little (1955) 


and Stilson, Gynther, and Gertz (1957) have 
emphasized, the sample used here is the 
meaningful one for testing the efficacy of a 
clinical tool. Previously, the normal popula- 
tion had been drawn from hospital person- 
nel. Here, all the patients had neurologic 
symptoms that had to be evaluated. Some 
later were considered on the basis of neuro- 
logical tests (examination, EEG, pneumo- 
encephalogram, etc.) to have organic brain 
pathology above the foramen magnum, and 
some were not. It is on such a sample that a 
clinical tool of this sort must prove its use- 
fulness. 

Furthermore, at the time of testing, the 
final diagnosis of the patient was unknown. 
It is known this aids objectivity and lessens 
the danger of maximizing chance differences 
on the test between known groups. In the 
other studies, the investigators were working 
with known groups and could analyze their 
data with this in mind. 

Half scores are not used in obtaining the 
results reported in Table 2. The results still 
do not show significance. Fewer organics are 
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diagnosed correctly by this method than by 
the use of 4 scores. However, the number of 
false positives is considerably reduced. For 
this reason it seems preferable to use the 
scoring system of Gallese who does not em- 
ploy 4 scores. 

The results shown in Table 3 indicate that 
the amytal injection does make it more diffi- 
cult to perceive the spiral aftereffect. Of the 
organics, 78.8% are correctly picked up. 
However, as there are 65.0% false positives, 
this procedure is useless as a diagnostic tool, 

The results reported in Table 4 are the only 
significant ones. Half scores were not used 
here. Once again the indication is that the 
use of 4 scores is a poorer method of dif- 
ferentiation than is the use of whole scores, 
As in Table 2, there is a pick-up of 66.7% 
of the organics, with only 35.0% false posi- 
tives. Although these results are significant 
(p .05), it is questionable whether the dif- 
ferentiation is clear-cut enough to warrant 
the patient’s being subjected to this rather 
lengthy and disagreeable procedure at this 
time. Additional work is needed to determine 
the validity of this Procedure and to give an 
indication of its usefulness as a Clinical tool. 

Under none of these conditions do the re- 
sults in any way duplicate the work previ- 
ously done with the spiral aftereffect test, 
Therefore, at the Present time it seems that 
this test is not a useful clinical tool to deter- 
mine the presence of organic brain pathology 
in a general hospital population, 


Table 3 


Discrimination Value of 


i Spiral Aftereffect Tests 
Using Price and Deal 


bler’s Scoring System 
(After Amytal) 


Spiral Criterion 


Neurological Classification 
Price and Deabler 


(1/2 scores) 


Organic Nonorganic 
Organic scores 0-2 
No. of patients 26 7 
% of patients 78.8% 21.2% 
Nonorganic scores 3-4 
No. of patients 13 Fi 
% of patients 65.0% 35.0% 


Note.—Chi square, p > .25, 


Emily B. Philbrick 


Table 4 


Discrimination Value of Spiral Aftereffect Tests 
Using Gallese Scoring System 
(After Amytal) 


Spiral Criterion 
————— ees 


Neurological Classification 
Gallese Scoring 


a S a 


(No 1/2 scores) Organic Nonorganic 
Organic scores 0-2 
No. of patients 22 11 zi 
% of patients 66.7% 35.0% 


Nonorganic scores 3-4 
No. of patients 7 13 a 
% of patients 35.0% 65.0% 


Note.—Chi square, p < 05. 


It was often noted that the organic pa- 
tients who saw the aftereffect seemed to no- 
tice it for a shorter duration of time than did 
those without brain pathology. This was also 
noted by Gallese. A study is now in progress 
to determine whether the duration of the 
aftereffect will differentiate organics from 
nonorganics in this general hospital group. 
Although such procedures were not include 
in the present study, it might be valuable n 
study the effect of increasing the difficulty 0 
seeing the aftereffect by reduced lighting, 
lowered speed of rotation, etc., rather than 
by the arduous process of administering 
sodium amytal. 


Summary 


1. Eighty-one patients admitted to the tee 
rology ward of a Veterans Annsa 
general hospital were given the Archimedes 
Spiral Aftereffect test. This was administere 
in the manner reported by Price and Dene 
(1955) and Farrett et al. (1957), and wget 
according to their method and also by tha 
of Gallese (1956). me 

2. Fifty-three patients received the war 
stein amytal test after being given the spira 
test and were then retested on the spiral. 

3. The diagnostic category into which = 
patients fell was unknown at the time of tes A 
ing. After the sample had been run, at leas 
two neurologists rated each patient as hav- 
ing, or not having, organic brain pathology 
above the foramen magnum. There was dis- 
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agreement in nine cases, so these were omitted 
from the analysis. 

_4. Analysis of the results indicates no sig- 
nificant differentiation, except after the amy- 
tal injection using Gallese’s scoring system. 
However, the presence of 35% false positives 
with this rather involved procedure discour- 
ages its use as a clinical tool, at least until 
further research has purified the procedure 
and validated its usefulness. Thus it appears 
that in its present form the spiral aftereffect 
test is not useful for diagnosing organic brain 
Pathology in a general hospital setting. 
Received January 20, 1958. 
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THE YOUNG REBEL: 
SELF-REGARD AND EGO-IDEAL? 


EVA MARIA SHIPPEE-BLUM 
San Mateo Community Hospital, California 


This study was undertaken as a part of a 
larger investigation of the ego-structure of 
rebellious adolescents (Shippee, 1954). For 
this purpose, the Psychoanalytical frame of 
reference was adopted since it provides a con- 
venient conceptualization of underlying þe- 
havior determinants in terms of the construct 
of ego, varying on a continuum of ego-weak- 
ness to ego-strength. The primary hypothesis 
to be tested was that young rebels are en- 
dowed with less ego-strength than their more 


an adequate ego 
Wineman, 1952), 

Freudian theory accords the ego the role of 
mediator between the demands of successful 
survival in the world of reality and the de- 
stinctual impulses. Such a. 86 
tion” depends u 


various defense 


ance, etc. 
The connection between “ 
1This investigation w. 


research grant (M-528) 
of Mental Health of 


reality orienta- 


clay Martin, and Josep! 
research. 


tion” and “ego” is described by Fenichel 
(1954, p. 35): “The origin of the ego and 
the origin of the sense of reality are but two 
aspects of one developmental step.” 

The sense of reality, also designated as the 
“reality principle” in contra-distinction to the 
“pleasure principle,” implies, as indicated 
above, the ability to wait, to postpone im- 
pulse gratification. A temporal delay is 1n- 
terpolated between the original stimulus-re- 
sponse unit typical for infant behavior. The 
long-circuiting of immediate reflex-type dis- 
charge phenomena is made possible by the 
emergence of intervening symbolic pe 
i.e., the emergence of the ego. Fenichel (1954, 
P. 367 ff.) writes as follows: 


The infant as long as he acts according to the Loe 
ure principle tries to discharge tensions immed 
and experiences any excitement as “trauma,” W a 
is answered by uncoordinated discharge moyne i 
... They [impulse neurotics, i.e., delinquents; e Ai 
still act as if any tensions were a dangerous “trauma. 


As mentioned before, in this study we a 
concerned with the ego’s attribute of ay 
strength. In order to pass from the level na 
abstraction to the behavioral aspects of site 
strength, Block’s (1950) intervening ee 
“ego-control” is adopted in this ipestron 
“Ego-control” is to provide the erie 
step from ego-strength as manifested in Gai 
sion-binding-capacity,? to the experimen A 
measure thereof. The ego-control system, = 7 
cording to Block, functions to mne n = 
most subjectively efficient balance for the of 
dividual between immediate gratification E 
needs and delay of gratification congrue 
with the requirements of the external wo 

2 Tension-binding-capacity as used here is the tech- 


i iptive terms: ten- 
i uivalent for the more descript i 
E E frustration-tolerance, impulse-control 
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He states that the ratio—Immediate Gratifi- 
cation/Delay of Gratification (IG/DG)— 
tends toward maximization as a consequence 
of the hedonic postulate which most person- 
ality theories accept. Block terms individuals 
who more or less maintain an optimal IG/DG 
ratio as Adequate Controllers. This designa- 
tion corresponds to what the present writer 
refers to as optimal ego-strength. Block dis- 
tinguishes between the Adequate Controller 
and the Under Controller; the latter is one 
Whose ego-control system has insufficiently 
developed the necessary tension tolerance. 
His ID/DG ratio is above the optimal range. 
We recognize in the individual with low ten- 
sion tolerance one of the aspects of impaired 
ego-strength discussed previously as 4 factor 
1n rebelliousness. : 

In this study the major hypothesis of de- 
Creased ego-strength in the rebellious adoles- 
Cent was tested by comparing the tension- 
binding-capacity of a group of rebellious 
adolescents to an equated group of coopera- 
tive adolescents, As an operational definition 
of low tension-binding we adopted Block's 
(1950) inferred variable «“ynder-control and 
his IG/DG measure thereof which consisted 
of a questionnaire designed to assess under- 
Control. The prediction which follows Is: On 
an ego-control questionnaire designed to ae 
ure Impulse Gratification vs. Delay of Gratifi- 
Cation, the rebel will be on the under-con- 
trolling end of the distribution of scores. : 

Two subsidiary hypotheses were derive 
from the primary concept of ego-weakness e 
the rebel. The first hypothesis was ce e 
Tebel’s reality testing is inadequate. pe 
cifically, it was predicted that one geese 
aspect of reality testing is distorted, ee 
the objective evaluation of the rebellious a a 
lescent’s own self. Indeed, a realistic bs ; 
evaluation is only possible if the indivi ua 
is able to tolerate the frustration arising from 
an awareness of his limits. Such a fa 
tolerance requires a strong €80- Consequent: 3 
a person lacking the prerequisite ego-strength, 
as exemplified by the rebellious adolescents, 
will show low frustration tolerance. Low frus- 
tration tolerance may manifest itself in vari- 
ous ways; for instance, in 4 narcissistic Ori- 
€ntation toward the self. 


_ 
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Following Block (1950), it was posited 
that self-evaluation varies along a continuum 
ranging from unrealistically favorable to un- 
realistically unfavorable. Present evidence in- 
dicates that a realistic self-regard implies 
moderate self-esteem. A narcissistic self-re- 
gard, on the other hand, can manifest itself 
either as feelings of grandiose self-esteem or 
in the converse, as feelings of exaggerated in- 
feriority. 

In the present study, the self-regarding at- 
titudes of a group of rebellious adolescents 
were compared to the self-regarding attitudes 
of an equated group of cooperative adoles- 
cents. Realistic self-regard was defined as 
moderate self-esteem. It was measured opera- 
tionally by scores clustering around the mean 
of the distribution obtained on an instru- 
ment designed to measure self-esteem. 

Narcissistic self-regard was defined as im- 
moderately high self-esteem or extremely low 
self-esteem. It was measured by extreme 
scores on either the high or the low end of 
the distribution of scores obtained by means 
of an instrument designed to measure self- 
esteem. 

The hypothesis of impaired ego-strength in 
the rebellious adolescent allowed the deduc- 
tion that they will exhibit narcissistic atti- 
tudes toward themselves. Such attitudes were 
defined both as immoderately high self-esteem 
and as extreme feelings of inferiority. From 
this a second prediction follows: On an adjec- 
tive list, checked for socially valued attitudes 
of the self, the rebel will tend to obtain ex- 
treme self-esteem scores, revealing feelings of 
exaggerated worth or inferiority. 

The third hypothesis derived from the as- 
sumption of ego-weakness in the rebel is that 
of inadequate ego-ideal formation. Psycho- 
analysts regard the superego as an outgrowth 
of the ego, an outgrowth which depends upon 
the ego’s tension-binding function, which 
serves to delay impulse gratification until 
such gratification is compatible with demands 
imposed by society (Fenichel, 1954). Ordi- 
narily it is the parents who first mirror the 
society and who transmit societies’ codes and 
expectations through the application of re- 
wards and punishments. According to psy- 
choanalytic theory, the superego results from 
the child’s emotional acceptance and subse- 
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quent internalization of parental demands 
and prohibition. Such an acceptance and in- 
ternalization requires that the ego be strong 
enough to renounce present pleasures for the 
sake of later (parental) approval. In the 
child this capacity to renounce is acquired 
as a Consequence of the ego’s developing abil- 
ity to tolerate tension. 

But the ego of the rebellious adolescent is 
weak and cannot tolerate tension. The rebel 
is impulsive. His impulsiveness demonstrates 
his ego weakness. If his ego is too weak to 
bind tensions it should also be too weak to 
allow the internalization of parental demands 
which constitute the growth of the superego 
(Zucker, 1943). Thus it can be expected that 
the superego formation of rebels is defective. 
That is the hypothesis tested here. 

For the Purpose of this ex 
one aspect of superego defect was investi- 
gated. It was the assessmen 


; r t of the forma- 
tion of the ego-ideal, i.e., the formation of 


periment, only 


S ego-ideal was meas- 


ationship between the 
subject’s esteem for his 


self-estee 


r than unity. 
On an ego-ideal 
esteem will tend to 
Parents, i.e., he will 
t-esteem/self-esteem 


Prediction 3 stated that: 
measure, the rebel’s self- 
exceed his esteem for his 
tend to obtain a paren 
ratio below unity, 


The Sample 


The Ss used in this study were 75 high 
school students from the freshman and sopho- 
more classes of a suburban high school. Their 
modal age was 14 years, with a range from 
13 to 16 years. Their intelligence was aver- 
age, with a mean at the 54th percentile on 
the American Council of Education test bat- 
tery. The social status of the Ss’ parents was 
predominantly middle class. 

Procedure for categorization. In order to 
divide the preliminary sample into the rebel- 
lious and cooperative groups, independent ob- 
servations of the students were obtained. On 
the basis of these observations, the sample 
was divided into three groups according to 
the severity of the discipline problem which 
the Ss presented to the high school authorities. 
For the final sample of 75 Ss, only the two 
extreme groups were retained, the middle 
group was eliminated. : 

Three sources of information were utilized 
to establish criteria for placement of each S 
into one of the three groups: the rebellious 
group, the moderate group, and the coopera- 
tive group. One source was the Ss’ citizenship 
grade obtained during an 18-week interval. 
For each S, 18 ratings were available (three 
ratings by each of his six teachers). 

The second source of information was the 
teachers’ rankings of all the students in the 
freshman and sophomore classes on a com 
tinuum of rebelliousness. The third source 0 
information was the dean’s black list. On that 
list were found the names and the offenses of 
those students who had not responded to the 
teachers’ disciplinary measures. This group 
of pupils represented the most serious disci- 
plinary problems calling for special handling: 

The three scores obtained from trichotomiz- 
ing the distributions of citizenship peer 
teachers’ rankings, and presence on the blac 
list were combined for each S. A new ire" 
quency distribution was made for the com 
bined scores. Ss whose combined score was i? 
the highest third were classified as rebels. S$ 
who obtained a zero score were designated aS 
cooperators. The remaining middle group we 
eliminated from the final sample. The fina 
sample of 75 Ss comprised 30 cooperators 
and 45 rebels. No significant differences were 
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found between the age and the intelligence 
of the Ss in the rebel and cooperator groups. 
Nor were any significant differences found in 
the occupational status of their parents. 


The Instruments 


The Ego-Control Questionnaire 


To measure ego-strength as a function of 
the individual’s capacity to bind tensions, Le; 
to control impulse gratification, a question- 
naire was constructed. The method of its con- 
Struction, the reliability and validity are dis- 
cussed in full by Luft (1957). A few examples 
rom the ego-control questionnaire are given 

elow: “I sometimes open presents before Pm 
Supposed to.” “I usually make a plan before 

Start to do something.” “I am always calm 

and cool.” “I lose my temper easily.” 


The Adjective Check List 


| To assess self-regarding 
‘deal formation, an adjective 
devised. Each adjective inclu a 
ad to meet the following criteria: (a) it had 
to be intelligible to the average freshman, (0) 
ìt had to describe personality unambiguously 
either favorably or unfavorably in the areas 
of intellectual, emotional, interpersonal, ane 
Physical functioning, (c) it had to differenti- 
ate between Ss, and (d) it had to Ppa 
ate between the Ss and their fathers an 
Mothers. d 
_ Pretests on 72 high school sophomore P 
Junior students yielded a preliminary p00 
51 adjectives. These were screened by | 
sulting the Thorndike-Lorse word ie 
eliminate all those adjectives which were be- 
Yond the understanding of the ie aas 
Year-old. In another pretest, the, ane ‘the 
Were further screened for intelligibility: h 
72 pretest students were asked to define on 
of the randomized adjectives by making ‘a h 
tences out of them. Only those vanes i 
the students had been able io correctly 
were retained in the revision list. 
To establish the positive oT negative vale 
connotations of the adjectives empirica os h 
high school juniors were asked to judge A 
word. Eighty per cent agreement peg et i 
as to favorable implication had been dac) z 
upon as the cutting point. Accordingly, eac 


attitudes and ego- 
check list was 
ded in the list 


word for which there was less than 80% 
agreement was eliminated from the list as be- 
ing too ambiguous a value statement to allow 
a clear differentiation of its positive or nega- 
tive connotation. 

The remaining 100 adjectives were pre- 
tested to weed out all those which did not 
differentiate sufficiently between Ss. An item 
analysis of the responses to the adjectives 
was made. Twenty-five adjectives which pro- 
duced the same response in all of the Ss were 
rejected. Seventy-five items were retained in 
the final form of the adjective check list. The 
final adjective check list was administered to 
two freshman classes (V = 63) to pretest its 
discriminatory power for three test condi- 
tions: (a) self description, (b) description 
of fathers, and (c) description of mothers. 
It was found that the final form of the adjec- 
tive check list differentiated adequately under 
all three conditions. 

The following 75 words constituted the 
final check list: 


Well Dressed Timid Foolish 
Confident Jumpy Worried 
Thoughtful Impatient Irritable 

Slow Narrow Interests Confused 
Humorous Graceful Bossy 

Insecure Jolly Nervous 
Enthusiastic Blue Bright 

Angry Sunny Disposition Messy 
Cooperative Skillful Vigorous 
Ashamed Easily Hurt Easy Going 
Selfish Nagging Obeying 
Quarrelsome Moody Generous 
Cheerful Inventive Strong 

Helpful Tired Relaxed 

Sulky Awkward Sociable 
Creative Merry Sympathetic 
Considerate Calm Catch on Quickly 
Good Looking Alert Gentle j 
Popular Resentful Well Groomed 
Attractive Athletic Clear Thinking 
Dull Even Tempered Contented 
Highstrung Original Clumsy 
Respected Loving Agreeable 

Wise Intelligent Artistic 


Complaining Warm Good Natured 


The adjective check list was administered 
to the experimental sample under three con- 
ditions: 

Condition A: Each S was asked to mark as 
true the adjectives which described him as he 
really was. 

Condition B: Each S was asked to mark as 
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true all the adjectives which described his 
father as he (the S) saw him. 

Condition C: The instructions for Condi- 
tion C were to mark as true those items which 
described the S’s mother correctly. 

The adjective check list was scored by 
counting separately the number of Positive 
attributes by each S under each of the three 
conditions. Three total esteem scores were 
thus available for each S. The self-esteem was 
measured by the score obtained under Condi- 
tion A. The father-esteem was measured by 
the score obtained under Condition B, and 
the mother-esteem was measured by the score 
obtained under Condition Ci 


The Ego-Ideal Measure 


For the purposes of this study, 


ego-ideal 
was defined ae 


the §’s 
S self-esteem, 


Table 1 


Chi Square Table of the Relationshi 
ship Bet 
Low Ego-Control and Rebelliousness 


Ego-Control 


Coop- 
Scores erators Rebels Total 
10-31 
UC 10 29 39 
32-46 
oc 16 15 31 
Total 26 44 70 


Note.—r; = .43; x? 


= 4.99; 055 b >02. 
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ratio equal or above 2.00 denoted strong ego- 
ideal. 


Results 


Relationship between tension-binding-ca- 
pacity and rebelliousness. This study’s basic 
assumption of ego-weakness in the rebel led 
to the hypothesis of the rebel’s decreased 
tension-binding-capacity. Operationally, ten- 
sion-binding-capacity was defined as the ratio 
between impulse gratification vs. delay of 
gratification (IG/DG ratio). It was predicted 
that on a questionnaire designed to measure 
the IG/DG ratio the rebel will be on the 
under-controlling end of the distribution, i.e. 
he will obtain lower scores. 3 

The ego-control questionnaire was adminis- 
tered to 26 cooperators and 44 rebels. The 
tetrachoric correlation was computed as 4 
measure of the degree of association betwee? 
rebelliousness and under-control. Statistical 
analysis yielded an Te = 43. The chi square 
Was 4.99, which for one degree of freedom is 
significant between the .05 and .02 levels of 
confidence. 

This degree of statistical significance sup- 
ports the hypothesis that decreased tension- 
binding-capacity as defined here and rebel- 
liousness are correlated. 

Relationship between “unrealistic” self- 
esteem and rebelliousness. The hypothesis 
of decreased tension-binding-capacity in the 
rebel permitted the inference that the rebe! 
will show deficiencies in reality-testing a5) 
for instance, in his capacity to evaluate him- 
self realistically. Prediction 2 stated that the 
tebel’s unrealistic self-regard would be re- 
vealed on the adjective check list in extreme 
Self-esteem scores, indicating feelings of ex- 
aggerated worth or inferiority. 

The obverse was predicted for the coopera- 
tor: his more realistic self-regard was ex- 
pected to yield moderate self-esteem scores- 

The adjective check list was administer! 
to 30 cooperators and to 45 rebels. It was 
scored by counting for each S the number of 
Positive adjectives checked. The difference i? 
variance of the two distributions of scores was 
tested. The obtained sigma for the coopera- 
tors was 8.51; the sigma for the rebels was 
12.71. The observed difference was in the 
predicted direction and yielded an F ratio of 
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2.21. For 44 df and 29 df, respectively, the 
obtained F ratio is significant beyond the .01 
level of confidence. This degree of statistical 
significance supports the hypothesis that “un- 
realistic” self-esteem as defined by extreme 
Scores on a self-esteem measure is a function 
of rebelliousness. 

Relationship between rebelliousness and 
ego-ideal weakness. A weakened ego-ideal in 
the rebel was predicted from the hypothesis 
of impaired ego-strength underlying asocial 

ehavior and the consequent defective super- 
ego functioning. Prediction 3 stated that the 
ego-ideal ratios of rebellious adolescents 
Would tend to be less than 2.00, or unity, 
More frequently than the corresponding €50- 
ideal scores of cooperative adolescents, which 
Would be found more frequently above unity, 
ie., be equal to or greater than 2.00. 

The adjective check list was administered 
to 25 cooperators and to 39 rebels.’ By sum- 
ming the father- and mother-esteem scores 
and dividing the result by the self-esteem? 
Score (F + M/S), the “ego-ideal” ratio was 
Computed for each S. 

n order to show that the re : ; 
ently than cooperator; tend to reject their 
Parents as ego-ideal; chi square was com- 
Puted. The obtained chi square of LOSE 
Significant beyond the .05 level of Conta 

One-tailed test), for 1 df. The DECSS 
that rebels have a weaker ego-ideal is SUP- 
Ported by the data. The results are summa 


"zed in Table 2. 


pels, more fre- 


Discussion 


A great deal of knowledge has parce ies 
regarding the determinants of asocial i s is 
ior in the juvenile delinquent. Much e5] 

nown about the “average” wa sde- 
escent who has perpetrated similar ren 
Meanors but has not come to the aie as 
Of the law. The study presented here i 
Concerned with the rebel before, ate a 
after, social intervention has branded ee 
a member of a special outgrouP- Os 
from one set of con- 


8 
The number of Ss decreased hose who had filled 


ditions to another. Not all of t iti 

out the adjective check list under Coes k ‘The 
willing to continue under Conditions B: ane d five 
attrition rate was six Ss, one cooperator an 
rebels. 


Table 2 


Chi Square Table of the Relationship Between 
Weak Ego-Ideal and Rebelliousness 


Ego-Ideal Coop- 

Ratio erators Rebels Total 
1.00-1.99 5 16 21 
2.00-+4.50 20 23 43 
Total 25 39 64 


Note—x? = 3.05 (predicted direction); p < .05. 


lious adolescents were at the time of the 
study in regular attendance at school. Al- 
though they were known to their teachers and 
counsellors as difficult to handle, they were 
more nearly representative of the adolescent 
population than the “Jegal delinquents” upon 
whose behavior much of the research on 
asocial behavior has been based. The study 
of the rebel was conceived of as contributing 
a link in the continuum of social behavior, 
ranging from the extremely disruptive to con- 
structive activities. The psychoanalytic con- 
struct “impaired ego-strength” presented it- 
self as a convenient unifying principle, which 
allowed us to order divergent behavior mani- 
festations into one system. The positive find- 
ings of this study substantiated psychoana- 
lytical theory at several levels of abstraction. 
By extrapolating from the data, the primary 
explanatory principle was confirmed to the 
extent that the study affirmed the lower order 
hypotheses derived from the construct “im- 
paired ego-strength.” 

There is no doubt that alternate hypothe- 
ses of the observed results can be proposed. 
These are certain to occur to the critical 
reader and are therefore not offered here. 
Many possibilities for extending the present 
research will also come to mind. Of these only 
one is mentioned here: the argument that the 
rebels were correct in their negative evalua- 
tion of their parents cannot be met directly in 
the absence of any objective descriptions of 
the two sets of parents. It may be that dis- 
passionate observers would tend to agree with 
the rebels that their parents were less ad- 
mirable than parents of cooperators; but per- 
haps not. In the event that the rebels were 
correct in stating that their parents had few 
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socially desirable traits, one could then as- 
cribe their defective superego to the inade- 
quacies of their models and the conflict be- 
tween their parental models and the ideals 
held up by the society in which the rebels 
live. If that is the case, superego development 
must be viewed in terms of the actual failing 
of parents to provide worthy behavior models 
to the child. On the other hand, should it be 
shown that objective evaluation of the rebels’ 
parents proves them not to differ from other 
parents in the possession of socially admir- 
able traits, then the qualities attributed to 
parents by rebellious offspring represent their 
own peculiarly dour views, Whether such 
views would originate from hostility, 
pointment, or Projection remains to 
vestigated. 

The evaluation of the parents of rebels 
eckons as the next research step. 


disap- 
be in- 


b 


Summary and Conclusions 


A sample of high school students was di- 
vided into 45 rebels and 30 cooperators. A 
questionnaire Was constructed to measure ego- 
Strength defined as tension-binding-capacity. 

€belliousness was correlated with decreased 

-binding-capacity, An adjective check 

list Was developed. On it rebels revealed un- 
realistic self-regard, which differed from the 
-appraisal of the cooperators. 


ebels were found to regard themselves more 


Eva Maria Shippee-Blum 


highly than they regarded their parents; C0- 
operators admired their parents more than 
themselves. 


The results supported the psychoanalytic 
thesis of ego-weakness in the rebel. Implica- 
tions for further research were discussed. 


Received January 21, 1958. 
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AN APPROACH TO THE FACTOR STRUCTURE 
OF CLINICAL JUDGMENTS 


MARTIN D. CAPELL anp JULIAN WOHL 
VA Mental Hygiene Clinic, Detroit 


There is a growing awareness in the clinical 
field that the process of describing, rating, or 
Classifying a person is extremely complex and 
that there are many determinants of the clini- 
Cal impression or judgment. Previous studies 
(Buss & Gerjuoy, 1957; Grayson & Tolman, 
1950) of concepts used by clinicians have 
not been concerned with either the clinical 
judgment itself or with attempting empiri- 
Cally to dimensionalize the concepts. Psy- 
chologists tend to be critical of their concepts 
and suspicious of themselves inasmuch as 
they have come to recognize that, 1n making 
Judgments about other people, they do so not 
only as scientists but also as human beings. 

€cent interest in the utilization of counter- 
transference in the psychotherapeutic process 


ohen, 1954) is one aspect of this concern. 
ices me with the seman- 


iudgments of 
ah Oe ents could be 
f three factors: 
cy. The evalua- 
e accounted for 
al variance m 


valuation, activity, and poten 
me (“good-bad”) factor gion 
Proximately 50% of the to if 
2 judgments. i ie present study, te ed 
tor structure of clinical judgment is Pav to 
8ated with particular interest being given ji- 
€ role of the evaluative factor M such judg 
Ments, 


Method and Procedure 


The psychiatric, social work, and psycho- 
logical atts at the Detroit VA Mental Hy 
giene Clinic, a total of 28 persons, were ep” 
Proached individually and requested to io 
10 of the concepts they commonly used ™ 
describing patients. Following, each eo 
was asked to indicate the “opposite” of eac 
Of the concepts he or she had contributed. 
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The obtained concept-dimensions were cate- 
gorized by the Es. Twelve dimensions were 
selected on the basis of frequency of occur- 
rence (four or more). These were as follows: 


anxious—calm 

narcissistic, self-invested—object-invested 

inhibited, rigid, reserved—expansive, expres- 
sive, outgoing 

orally demanding-realistic help-seeking 

flat, apathetic, affectless-sensitive, emotion- 
ally responsive 

defensive, guarded-open, free of defensive- 
ness 

distorted reality testing—undistorted reality 
testing 

precarious, transient interpersonal relation- 
ships-stable, firm interpersonal relation- 
ships 

hostile, unaccepting, suspicious-friendly, trust- 
ing, accepting 

passive-active, aggressive 

dependent-independent 

inadequate—adequate, capable 


Three of the dimensions which Osgood found 
to load highly on the evaluation factor were 
added: 


pleasant—unpleasant 
honest-dishonest 
kind-cruel 


Finally, psychoanalytic con- 


structs: 


five typical 


much secondary gain-little secondary gain 

positive Oedipal strivings-negative Oedipal 
strivings 

genital character—pregenital character 

many anal character traits-few anal charac- 
ter traits 


Martin D. Capell and Julian Wohl 


Table 1 


Rotated Factor Matrix Derived from 
Scale Intercorrelations 


Factor> 
Scales* I © mi iw 
Anxious 09 6l 58 07 
Narcissistic, self-invested —36 67 —02 07 
Inhibited, rigid, reserved —57 45 —09 54 
Pleasant 85 05 —40 ~25 
Orally demanding —72 00 06 30 
Flat, apathetic, affectless —51 46 12 46 
Defensive, guarded = 45 5 06 
Much secondary gain —26 24 —26 —08 
Positive Oedipal strivings 32 —35 —02 15 
Distorted reality testing —80 21 28 —18 
Precarious, transient inter- 
personal relationships 03 4 S51 5y 
Kind 6 —03 00 33 
Genital character 40 —26 24 03 
Hostile, unaccepting, 
suspicious —17 8&2 00 54 
Many anal character traits 03 33° 36 o 
Passive —34 61 15 48 
Many oral character traits —06 61 48 17 
Dependent —08 94 5 01 
Honest 50 —01 45 06 
Inadequate 12 68 —12 o9 
Ni 


ote—Decimal points have been o; 
loadings, 


* Only the positive ends of the scal V. 
Consult the text for the complete scales, fe ae eas 
$ mean squared factor | li. vs: ; 

1, 258; ines re ie gad ings are as follows: I, +198; 


mitted in the factor 


many oral charac 


i ter traits-few oral character 
traits 


Product-moment intercor 
ales were obtained, and 
analysis Performed on the 


through the locus of the points which defined 
the three evaluative scales. The remaining 
factors were rotated blindly and orthogonally. | 


Results and Discussion 


The rotated factor matrix is given i 
Table 1. The scale loadings on Factor I, t 


factor in which the evaluative component 10 
the ratings was maximized, suggest that 4 
number of clinical concepts have an evalua- 
tive meaning along with their diagnostic a 
tent. In particular, such concepts as distor A 
reality testing, orally demanding, inhibite l) 
and flat appear to reflect in large part “bad 
characteristics, while genital character ant 
positive Oedipal strivings have “good” impli- 
cations. In the light of this evidence, caution 
in the use of these terms in clinical parlance 
might well be considered. d 
The mean squared factor loading on Fag 
tor I (.198) constitutes approximately 30% 
of the common factor variance obtained. TER 
can be contrasted with the results oprani 
by Osgood (1953), where roughly 70% 0 
the common factor variance was evaluative. 
Thus, as compared with college students per 
forming semantic ratings, clinical judgmen* 
appears to be relatively unbiased. This ae 
parison needs to be limited by the fact th j 
the ratings in the present study are presura 
ably denotative, rather than connotative as 
Osgood’s study. : Fe 
Factor II, orthogonal to the evaluative ae 
tor, appears to be a dimension of psyčhopãí 
thology and contains about 47% of the be 
mon factor variance. It suggests that ae. 
judgment of pathology is predominantly a 
biased by evaluative considerations, F er 
HI and IV do not appear to be as read 
interpretable. Factor IIT is tentatively iden 1g 
fied as a dimension referring to the Pee 
desire and need for Psyichotherapeutic H 
vention. Factor IV appears to be an inhi 
tion or social withdrawal dimension. ly 
The present study can be considered ae 
as exploratory, considering the small N E 
volved. Nevertheless, the obtained EEI 
follow along lines that might be expected d 
an outpatient, psychoanalytically omien a 
psychotherapeutic agency. The clinic perso: 4 
nel look at the range and degree of psycho 


| 
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pathology, using generally psychodynamically 
derived concepts rather than those coming 
from descriptive psychiatry. They judge peo- 
Ple as to their need and wish for treatment 
and with regard to their accessibility to a 
Psychotherapeutic approach. A number of 
their concepts are endowed with considerable 
evaluative nuance. 


Summary 


The factor structure of clinical judgments 
was explored with particular interest being 
Placed upon the role of values in the making 
of such judgments. A group of mental hy- 
giene clinic personnel was asked to rate 
a patient on a number of scales derived 
from commonly used clinical concepts. Three 
“evaluative” scales and five psychoanalyti- 
cally derived scales were also included. The 
scales were intercorrelated and a factor anay 
sis performed. The first factor was rotate 


through the evaluative scales. Less than one 
third of the common factor variance was ac- 
counted for by this factor; it suggests that 
evaluation does play a part in clinical judg- 
ment. The remaining three factors were ten- 
tatively identified as dimensions of psycho- 
pathology, need and wish for psychotherapy, 
and social inhibition. 
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BODY REACTIVITY GRADIEN 


TS AND FIGURE 


DRAWING VARIABLES? 


SEYMOUR FISHER 
Baylor University College of Medicine 


There is now considerable literature (Fisher 


Fisher & Cleveland, 


lished (Fisher & Cleve] 
Cleveland, 1958) that 

individual’ 
likely he į 


More recently, 
were made which 


1 This study was supported by a P 
Career Inve: 


y ublic Health 
stigator grant (M-1578), 


manifest differences in the GSR reactivity of 
their right and left body sides and that ih 
pattern of these differences is linked W 
body image factors. | 
It is with this problem of right vs. left re 
activity that the Present paper concerns Pe 
self. Previous findings concerning this ee 
nomenon have been as follows (Fisher, 1950; 
Fisher & Abercrombie, in press): hile 
1. Right-handed subjects (Ss) who, w ‘ch 
wearing aniseikonic lenses, clearly ee a 
the left body side as smaller than, or me, 
to, the right side in their body image an we 
tions are significantly more likely than 5 a 
not making this distinction to manifes a 
GSR gradient such that the left side is m 
reactive than the right side. pout 
2. Right-handed Ss who are secure P by 
their over-all body images (as measure Fe 
reaction to tachistoscopically presented TA 
ture of mutilated bodies) show e 
greater left than right GSR emt ay 
Whereas Ss who are insecure about their co 
images either show no gradient at all or Th 3 
tively more right than left reactivity. Ne 
optinum GSR gradient associated Lee 
well integrated body image is the left di 
tional one. 5, ty 
3. Left-handed Ss fail to evidence signif 
cant relationships between body image me 
ures and the GSR gradient variable. vai 
A primary goal of the present Uae 
to determine how these findings would i dy 
up when approached in terms of eee edit 
image measures derived from figure — 
ings. Figure drawings were chosen for at 
cial study in this respect because the Dr h 
A-Person method has in the past been us 


| 
À 


e | 
inp 
more than any other measure for evaluat 
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body image variables (Abel, 1953; Bender 
& Keeler, 1952; Fisher & Cleveland, 1958; 
Silverstein & Robinson, 1956; Witkin et al., 
1954), 

The attainment of the first primary objec- 
tive resolved itself into two specific problems: 

1. To determine if GSR gradient patterns 
are linked with the right side vs. left side 
attributes of figure drawings. The specific 
Prediction would be that those Ss who depict 
the left side of the figures as smaller than the 
right side would show relatively greater left 
GSR reactivity than right reactivity. Those 
drawing the right side of the body as rela- 
tively smaller or who depict no differences 
between the two body sides would fail to 
show the optimum left directional GSR 
Sradient. N 

2. To determine if GSR gradient patterns 
are related to indices of over-all body image 
integration derived from figure drawings. 
Here the specific prediction would be hot 
Ss whose drawings evidenced good body i 

i . z e likely to be 

age integration would be mor ae 
typified by the norm left reactive E a 
ent than Ss whose drawings evidenced p 


body image integration. 
A second primary intent of the shoy ie 
to test, by means of figure drawings, 


3 s xistence of an 
Pothesis proposing that me the two body 


optimu radient between 

sides E ra a function of pena = 
individual has learned a clear aes pia 
tween male and female sex roles S$ 

the male is considered supè 
Strength. This hypothesis we 


a rather speculative train O has been much 
Oout of a proposition, W. m j É Cleveland, 
elaborated elsewhere (Fishe age atti 


S ó , dy im 
1958), that Be individuals a appearance 


marize 
of his body but rather express OY sum à 


E a experi 
Patterns of important soca iee in the 
ences, This point was well exe! hich an indi- 


finding that the definiteness w. 


jes is not 
3 ‘ 3 undaries 1S 
vidual ascribes to his body bo ue as meas- 


correlated with his actual pis cantly linked 
ured by body type but is sign’ in roles and 
with the definiteness of certai vai iS 
values he learned from the pari ties wf 
(Fisher & Cleveland, 1958). > attitudes 
this sort suggested that body image 


were primarily a projection onto a figurative 
“body screen” of important roles and concepts 
which had been learned. 

When, therefore, differences were found in 
the size and strength attributed by individu- 
als to their two body sides, and when these 
differences proved to be correlated with GSR 
gradients of reactivity, the question arose as 
to what underlying socialization variable or 
experience was being thus reflected. There 
were already observations in the literature 
(Fenichel, 1945; Wolff, 1943) which implied 
that attitudes toward the two body sides were 
influenced by conflicts about masculinity- 
femininity. It had been noted that in some 
dramatic instances schizophrenic individuals 
would act out sex role conflicts by developing 
the delusion that one side of their bodies was 
male and the other side female. Sufficient 
leads of this kind could be found so that it 
seemed logical to relate differences in right- 
left body image and the correlated GSR re- 
activity differences to sex role variables. One 
could reason that the definiteness of an indi- 
vidual’s right-left body image and GSR dif- 
ferences was correlated with how well he had 
learned a stable nonconflictual distinction be- 
tween the masculine and feminine roles. How- 
ever, it seemed doubtful that a distinction 
which attributed relatively greater power to 
the female than to the male and which there- 
fore was opposed to the usual cultural stereo- 
type of masculine-feminine size relationships 
could be maintained by the individual with- 
out a great deal of anxious confusion. So the 
final hypothesis which emerged proposed that 
a definite and optimum GSR reactivity gradi- 
ent between the two body sides was based on 
a significant body image distinction in the 
size attributed to the two body sides and that 
this distinction was in turn dependent upon 
the individual having learned to discriminate 
clearly between the male and female sex roles 
in such a fashion that the male was consid- 
ered to have greater size and power. 


Procedure 


Measure of Right-Left Body Reactivity 


The method for measuring relative right- 
left GSR reactivity has already been de- 
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scribed in detail elsewhere (Fisher, 1958; 
Fisher & Abercrombie, in press) and there- 
fore will be only briefly outlined. It is of the 
exosomatic type and involves simultaneous 
recordings from the left and right sides on 
separate channels against a relatively inac- 
tive upper arm. Resistance changes across 
the skin are picked up as changing potential 
and fed into a Grass EEG power amplifier. 
Recordings were taken simultaneously: first 
from the middle fi 
forefingers; then fr 
little fingers; 


sponding points on the palms. The currents 
to each finger 


Figure Drawing Measures 


Each S was asked to dr: 
ture of 


eee figure fully Tepre- 
The following measur, 
a pga es were derived from 


Seymour Fisher 


and also of the right and left legs. Arm and 
leg differences were chosen not only because 
they are often the most prominent indicators 
of asymmetry in figure drawings but also be- 
Cause other indices involving the trunk and 
head were highly unreliable due to the diffi 
culty in establishing “middle” reference points 
from which to make right vs. left measures. 
The length of each of the figure’s arms was 
measured with a Protractor from a point half 
way between the indicated boundaries of the 
uppermost part of the arm to a point at the 
tip of the longest finger. The length of each 
leg was measured from a point half way be- 
tween the boundaries of the leg at the point 
where it joined the middle of the body (crotch 
area) to a point indicated by the most distan 
toe. This leg measure was made only on the 
drawing of the man because in the instan 
of the female drawing the dress almost 4 
ways concealed the legs, is 

B. Over-all Body Image Disturbance. bee 
measure was derived from one which aie 
Previously used by Witkin et al. (1954). A 
was developed by Machover in an attempt d 
Predict on the basis of the individual’s bom 
concept how well he would perform on pe. 
requiring spatial judgments in very ae 
tured situations. Machover compiled an € i 
tensive list of about 40 figure drawing sigh 
which she considered on the basis of de 
experience to indicate lack of body confident 
and general difficulty in developing an a 
ceptable body concept. Scores computed ron 
these signs proved to differentiate siem 
cantly between Ss who presumably could ie 
their bodies adequately as a frame of refe 3 
ence for making spatial judgments and thon 
who could not do so. In reviewing Machoni 
list of signs, it became apparent that man? 
of them involved making rather complex a 
jective judgments. It was therefore decide 
to use only 14 of the signs which were att, 
on simple and relatively objective judgme” ip 
One penalty point, indicating disturbance a 
body concept, was assigned for the prese”! 
of each of the following signs: 


| 
1. Erasures. the ' 
2. Transparency such that the figure defies b | 
laws of perspective as regards the masking of ° 
jects when they are behind others, 
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Lack of any body part. 
Nose indicated only by two nostril dots. 
. Mouth indicated only by a line. 
One or more arms behind back. 
- Very crude or peculiar clothing. 
. Lack of breasts in the female figure. 
9. Shading of the body. 
10. Lack of margins and delimiting lines in the 
figure (e.g, cuffs, collar, hemline). 
11. Figure markedly off balance. 
12. Figure very small (less than one- 
of the page). ; 
‘13, Markedly unusual shading or elaboration of 
the crotch area. 
14. Opposite sex drawn first. 


OIA w 


half the length 


A total score was tabulated which equaled the 


sum of the penalty points assigned to both of 
the figures. It will be referred to as a Body 
Disturbance” score. The scoring was done 
blindly with all subject identification re- 
Moved. 


Subjects 


The Ss consisted of 34 men RE 
Their median age was 21 and their me 3 
educational level was 14 years. They ey 
mainly students who were recruited Ee 
lege organizations by paying eo ship ar- 
tion a fee to have its total members anded 
ticipate in the experiment. Only right- INA 
S were used because previous yok R 


: 958) had indicated that a v ae 
et ae a 
actors the relationships an nde a 


GSR variables are maske 
dividuals. 

C. Relative Size noe 
vs. Femininity. The assum . 
that the indfeiiual’s concept of eens 
Size and power attributes of the ma end 
Male roles would be indicated by the oie 
heights of the male and female et pro- 
drew. This was purely an ope meas- 
cedure. Each drawing was evalua a furth- 
uring from the tip of the head to 


ly 
‘ 3 f the legs. On 
est distant point on one at least one-half 


when the male figure was 

of an inch larger than the female E = 
the difference considered significant. ninimize 
terion was adopted in order a. te result 
chance differences in size which mg 

from stray pencil stroke extensions- 


and 16 women. 


d to Masculinity 
tion was made 


Results 


Tabulation of the data indicated that 21 
Ss were left directional in their GSR gradi- 
ents; 9 were right directional; and 20 mani- 
fested no gradient at all. A chi-square analy- 
sis demonstrated only a chance relationship 
between directionality of GSR and figure 
drawing right-left side size differences. This 
held true for the figure drawing arm meas- 
ures considered separately and also for the 
leg measures. Figure drawing asymmetry 
seems to bear no relationship to GSR re- 
sponse asymmetry. 

However, a significant relationship in the 
predicted direction was found by means of 
chi square between the figure drawing Body 
Disturbance scores and GSR directionality. 
Ss scoring below the median in Body Dis- 
turbance significantly (.001 level) more often 
manifested left directional GSR gradients 
than Ss above the median in Body Disturb- 
ance. Those above the median more often 
showed either no GSR gradient at all or 
right directionality of response. 

Eighteen Ss drew the male figure as larger 
than the female figure. Thirty-two drew the 
female figure as equal in size or smaller than 
the male figure. There were no sex differ- 
ences among the Ss in this respect. Chi- 
square analysis of the relationship of the 
GSR gradient variable to the sex size differ- 
ence variable indicated a significant relation- 
ship in the predicted direction. Those Ss who 
manifested the left reactive GSR gradient 
drew the male figure as larger than the fe- 
male figure significantly (.05 — .02 level) 
more often than did Ss who had no GSR 
gradient or who were right reactive. 


Discussion of Results 


A significant link between GSR direction- 
ality and asymmetry of the figure drawings 
was not demonstrated. This suggests that fig- 
ure drawings do not tap body image asym- 
metry attitudes in the same fashion as the 
aniseikonic lens technique (Fisher, 1958), 
which was first used to demonstrate a sig- 
nificant relationship between body image 
asymmetry and GSR right-left gradients. The 
aniseikonic lens measure required Ss to make 
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a series of size comparisons of their homolo- 
gous right and left fingers. This was done un- 
der conditions in which their perceptual fields 
were so distorted as to encourage projection 
of autistic attitudes. The aniseikonic lens 
method for evaluating body image asymmetry 
contrasts with the figure drawing method in 
two ways. First of all, it requires direct rather 
than indirect judgments about the individu- 
als own body. Secondly, it sets the specific 
task for the individual of making judgments 
regarding symmetry; whereas the figure draw- 
ing asymmetry measure is derived from re- 
sponses to a task having no specific symmetry 
connotations. This implies that if one wants 
to measure body image attitudes toward very 
specific areas or dimensions of the body, such 
a measure is most likely to be successful if it 
requires direct evaluation of these areas of 
the S’s own body. 

However, the results obtained relative to 
the figure drawing Body Disturbance score 
indicate that such specific evaluation by the 
individual of his own body is not necessary 
in order to measure more general and ab- 
stract body image dimensions. Th 
nificant relationship was found 
Body Disturbance score and the 
ent variable. Similarly, in a previous study 
(Fisher & Abercrombie, in press) it was 
possible to establish a significant relationship 
in the same direction between GSR gradient 
and an index of general body image disturb- 
ance based on reactions to tachistoscopically 
presented mutilated figures. This index, like 
the figure drawing Score, was an indirect 
measure which in no way required the S$ to 
make judgments about his own body, 

The demonstration of a link between the 
Body Disturbance Score and the GSR re- 
Sponse pattern adds further validity to the 
Proposition that body image attitudes influ- 
ence the body’s reactivity characteristics. But 
the most intriguing finding of the present 
study is that supporting the hypothesis con- 
cerning the relationship of GSR response pat- 
terning to definiteness of sex role distinction, 
Such a finding gives a bit of substance to the 
three-level general theory which has been 
proposed concerning tole, body image, and 
physiological reactivity. There is now at least 


at is, a sig- 
between the 
GSR gradi- 
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one empirical result, as modest and tentative 
as it may be, which indicates that a body re- 
activity pattern which has been shown to be 
related at one level to body image attitudes 
is at still another level related to the manner 
in which an individual conceptualizes an im- 
Portant life role. The presumption is that the 
body image attitude represents a translation 
into body terms of the role concept. But this 
remains to be proven. A study is now under 
way which attempts such proof by tracing 
the relationships of GSR patterns, body im- 
age attitudes, and role attitudes over a wide 


age range from early childhood through adult- 
hood. 


Summary 


Previous work demonstrated relationships 
between body image measures and GSR right- 
left reactivity gradients. In the present study, 
body image measures derived from figure 
drawings failed to confirm a previous find- 
ing regarding the relationship of body image 
right-left size asymmetry and GSR direction- 
ality. However, a figure drawing measure of 
over-all body image disturbance was found to 
be linked in the predicted direction with GSR 
right-left responsivity. Further, a significant 
relationship was established between a figure 
drawing measure of the individual’s concept 
of the relative size and strength attributes of 
the male and female roles and GSR reactivity 
gradients. The findings lend support to a gen- 
eral theory that relates role, body image, an 
physiological reactivity. 
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POPULATION DIFFERENCES IN CONSTRUCT 
VALIDITY 


GERALD S. LESSER 
Hunter College 


In the seldom definitive efforts to validate 
measures of personality variables, it fre- 
quently happens that a test of “construct va- 
lidity” (American Psychological Ass., 1954) 
performed on a particular population will 
not be confirmed by an otherwise identi- 
cal validating test performed on a different 
population. This Phenomenon has appeared 
in a variety of research areas, including at- 
tempts to establish the c 
projective measures 


he a tropos E BVA special 
application to validation studies of the well- 
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different populations, and (b) psychological 
variables may be identified which will allow 
Prediction of the nature of the differential 
validation results for different populations. 
The variable of anxiety was selected as one 
of the possible dimensions of population dif- 
ference affecting validation findings. Empiri- 
cal evidence (e.g., Grinker & Spiegel, 1945; 
Luria, 1942; Mahl, 1949) from diverse areas 
of psychological research links anxiety with 
disruption, disorganization, and erratic qual- 
ity of behavior. Kuhlen emphasizes this rela- 
tionship between anxiety and response vari 
ability, concluding that “anxiety will show in 
. shifts of mood, instability, unpredict- 
ability and... inconsistency in perform- 
ance” (Kuhlen, 1952, p. 268). In addition, 
many clinical discussions have centered upo” 
the influence of anxiety upon the validity of 
diagnostic test results, 
The present study does not, however, deal 
directly with the effects of general, pervasive 
anxiety but rather with anxiety specifically 
related to the expression of aggression. The 
assumption is made that this more circum- 
scribed anxiety will manifest certain conse- 
quences which resemble the effects of general 
anxiety, i.e., anxiety about aggression will bé 
associated with inconsistency in expressions 
of aggression at different times and in re 
Sponse to different measurement techniques: 
Individuals and populations exhibiting high 
anxiety over the expression of aggressio” 
should manifest greater variability in aggres 
sive response and, hence, should exhibit lowe" 
intercorrelations among measures of aggres- 
sion. The construct validity of measures g 
aggression should be difficult to establish in 
such populations. 
Direct assessment of anxiety about aggres~ 
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sion, independent of aggressive need strength, 
encounters formidable methodological difficul- 
ties. Indirect methods are suggested by the 
literature. For example, convincing evidence 
(Dollard, Doob, Miller, Mowrer, & Sears, 
1239; Hollenberg & Sperry, 1951; Miler, 
1948; Whiting & Child, 1953) exists for 
the relationship between inhibitory socializa- 
tion of aggression and the learning of anxiety 
about aggression. An indirect index of the 
Strength of aggression anxiety in preadoles- 
cent boys was obtained by measuring the at- 
titudes and practices toward aggression s0- 
“alization of their mothers. 


Hypothesis 


oa Population difference examined in this 
of Y represents a difference in the conditions 
earning to express aggressive responses 
a the resulting difference in anxiety about 
8gression, 
ti he hypothesis tested is that, under con 
a Ons of high anxiety over the expression © 
S8ression, the intercorrelations among Vati- 
ns Measures of aggression are significantly 
bee than under conditions of low anxiety 
®t the expression of aggression. 


Method 
Subjects 
l gine Ss were 44 white boys (ages Loe 
~2) and their mothers. The boys te 
from one fifth grade and two i a 
€s in two public schools. All of the z $ 
ti Peir mothers in these three classes p s 
“Dated, except one mother who refuse 


tet interviewed. The Kuhlmann-Andersot n 

| 2 Bence quotients of the boys ae ne 
Sch, to 119, with a mean of 102. he fami- 
lien O'S are in adjacent districts and E e 
Pa Constitute a relatively homogeneo 


Wer-class group. 


q rawn 
Strad, 
a 


Maternat Attitudes and Practices 


di Only one aspect of the environmental os 
itions of learning of aggressive behav! ae 
fasured, ie., the maternal attitudes a 
*actices supporting or prohibiting ers oa 

| Structured questionnaire-intervieW ee Fa 
the „Was orally administered to the mot SAF 
&r homes by a male interviewer. Ques 


regarding the support or prohibition of ag- 
gression constituted only one segment of the 
total interview; the entire interview schedule 
is described in detail elsewhere (Lesser, 1952). 
Pertinent to the present study were 8 items 
concerning the mother’s attitudes toward ag- 
gression in children, and 13 items about the 
mother’s practices in dealing with the aggres- 
sive behavior of her child. An illustrative item 
measuring maternal attitudes toward aggres- 
sion is: “A child should be taught to stand 
up and fight for his rights in his contacts 
with other children.” The four response al- 
ternatives of agree, mildly agree, mildly dis- 
agree, and disagree were allowed for this item. 
An example of an item measuring maternal 
practices concerning aggression is: “If your 
son comes to tell you that he is being picked 
on by a bully at the playground who is his 
own age and size, there would be a number 
of different things you might tell him. Would 
you tell him to ignore him and turn the other 
cheek?” Response alternatives for this item 
were Yes and No. Items that did not involve 
judgments on a four-point scale were trans- 
formed to have approximately the same range 
of scores as the items that involved four al- 
ternatives. 

A single score was obtained for each mother 
by combining all items, assigning plus scores 
to the responses indicating support of aggres- 
sion and minus scores to responses indicating 
discouragement of aggression. The range of 
scores was from + 9 to — 7, with a median 
score of +2. The corrected odd-even reli- 
ability coefficient was .80. 

The distribution of scores for maternal 
response to aggression was dichotomized to 
form one group of mothers (with scores above 
or at the median) whose attitudes and prac- 
tices were more supportive of aggressive be- 
havior than those of the other group (with 
scores below the median). The hypothesis de- 
mands that the intercorrelations among vari- 
ous measures of aggression for the children 
(N = 23) of the mothers who support ag- 
gression be significantly more positive than 
the intercorrelations for the children (N = 
21) of the mothers who oppose aggression. 
Boys whose mothers encourage aggression will 
be referred to as the Low Anxiety (LA) 
group; boys whose mothers discourage ag- 
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gression will be called the High Anxiety 
(HA) group. 


Measures of Aggression 


Children’s Form of Rosenzweig Picture- 
Frustration Study. Measures of extrapunitive- 
ness (E), intropunitiveness (I), and impuni- 
tiveness (M) were obtained through stand- 
ard group administration and scoring of the 
Children’s Form of the Picture-Frustration 
Study (Rosenzweig, Fleming, & Rosenzweig, 
1948), 

The present sample of 44 boys differs sig- 
nificantly (p < .05) from Rosenzweig’s nor- 
mative group of 10- to 13-year-old boys, 
manifesting higher E scores (55% vs. 42%), 
lower I scores (21% vs. 28%), and lower M 
scores (24% vs. 30%). 

The corrected matched-half reliability co- 
efficients for the group of boys whose mothers 
encourage aggression (Low Anxiety group) 
were: E, .85; I, .58; M, .82. For 


the group 
of boys whose mothers discourage aggression 


(High Anxiety group), the Corresponding re- 
liability coefficients were: E, .95; I, -73; M, 
-70. Differences in reliability coefficients for 
the two groups were not Statistically signifi- 
cant. These reliability coefficien 
what greater t 
for the Picture-Fr 


Was apparent. 
To insure com 
tion of the storie 


er, and to fa- 


the recording device, 
Instructions were: 
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I'm going to show you some pictures. These at 
pictures of two boys doing different things. What I'd 
like you to do is make up a story to cach of these 
Pictures. You can make up any story you wish} 
there are no right or wrong stories. Say what the 


boys are thinking and feeling and how the story will 
turn out. 


The 10 Pictures, in the order of presenta- 
tion, were: 


1. One boy is holding a basketball and the other 
boy is approaching him with arms outstretched. 

2. One boy is stamping upon an ambiguous ob- 
ject and the other boy is teaching for the object. 

3. One boy is sitting behind the other boy in # 
classroom and is leaning toward him. 

4. One boy is walking down the street, and the 
other boy, with fists clenched, is glaring at him. 

5. One boy, with fists clenched, is staring at 
other boy who is sitting, head bowed, on a box. 

6. One boy is sawing a piece of wood, and the 
other boy is leaning on a fence between them, talk- 
ing to him. 
7. The two boys, Surrounded by a group of othe! 


boys, are approaching each other with arms upraise 
and fists clenched. 


8. The two bo 
kneeling to arran 


the 


A fantasy aggression score was obtained fo! 
each S$ b 


Y Counting the number of times th? 
following acts appeared in his stories: fight 
ing, injuring, Killing, attacking, assaulting, to" 
turing, bullying, Setting angry, hating, break- 
ing, smashing, burning, destroying, scorning: 
expressing contempt, expressing disdain, curs” 
ing, swearing, threatening, insulting, belit- 
tling, repudiating, ridiculing, 

Fantasy aggression scores ranged from ; 
to 15, with a mean of 5,3. The correcte 
matched-half reliability coefficient for th? 
group of boys whose mothers encourage 48° 
gression (Low Anxiety group) was .88. Fo! 
the group of boys whose mothers discourag® 
aggression (High Anxiety group), the rel 
ability coefficient was .85. 


Interjudge scoring reliability coefficient w35 
92. 


Overt Aggression. To measure overt aggres” 
sion in the child, a modified sociometric de“ 
vice, the “Guess Who” technique, was adopted: 
The Ss were presented with a booklet con’ 
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igh E of written descriptions of chil- 
deea R asked to identify each of these 
E Sok ive characterizations by naming one 
ies T classmates. Fifteen overt aggression 
who is ci used, such as “Here is someone 
of ag ways looking for a fight.” A diversity 
es T behaviors were included; items 
voked mie unprovoked physical, pro- 
oa p sical, outburst, and indirect forms 
88resive behavior. 

ech ba aggression score was obtained for 
Was ina y counting the number of times he 
sent by his classmates. There were sub- 
in the Parti among the three classes 
Sa distributions of the overt aggression 
fon is In order to combine into one distribu- 
Over: e scores of children in different classes, 
into aggression raw scores were transformed 

T standard scores. 

he biserial correlation coefficient between 
the ne aggression measure derived from 
«oe Children and teacher entries for the same 
01) Who” aggression items was 16 (p< 


Results 


ene intercorrelations among measures of 
a@punitiveness, intropunitiveness, and im- 


ap iveness (derived from the Picie a 
fon Stud fantasy aggression (derive 
he canta and overt 


rom a modified TAT procedure), r 
ectession (measured by a ociometric 
Corten ) are presented in Table * 
Ow on s are presented sep ‘ fais 
and piety group, the High Anxiety 8 
oth groups combined. 
Correlations are Pear 
te Coefficients. Over-all corre 
Cros aen by pooling within group Te 
ceg „Products and sums of squares; thi Pe ; 
ure is described by, for example, Mc 
od (1955). All probability values ae 
es upon two-tailed tests of significance. 
u ter plots revealed some skewness Be 
ried of distributions; hence, all rE S 
Son S were normalized for calculation of Pea 
qer duct-moment correlations. 
aa eid? proposes that each 
Criterion a employed constitutes 
Seve ion for every other measure. 
ti n correlations among the Picture- 
On, TAT, and near-sociometric measures, 


son product-mo- 
Jations were 
sums of 


measure of 
a validating 
For all 
Frustra- 
the 


Table 1 


Intercorrelations Among Extrapunitiveness (E), Intra- 
punitiveness (I), Impunitiveness (M), Fantasy Aggres- 
sion (FA), and Overt Aggression (OA) for Low Anxiety 
Group, High Anxiety Group, and Both Groups Combined 


E I M FA OA 
—.74* 
I —.59** 
—.04** 
—.so** = +.44* 
M —.68*} —.13t 
—.78** +.10 
+.48* —.38 —.44* 
FA +.20 +.11 —.39 
+.37**  —.14 —.40** 
+45* —47* —4s*  +.43* 
OA -a17 4.17 +aist Al} 
+.17 —.11 —.15 +.07 


correlation coefficients, the first 
coefficient represents the correlation for the Low Anxiety group 
(N = 23), the second coefficient represents the correlation for 
the High Anxiety group (N = 21), and the third coefficient 
represents the combined correlation for both groups. 
*p <.05 (two-tailed test). 
++p < .01 (two-tailed test). p 
+, t Low Anxiety group, significantly different (p < .05, < .01, 


respectively) from High Anxiety group. 


Note.—In each set of three 


coefficients for the Low Anxiety group are 
greater (in a direction indicating greater va- 
lidity of the measures) than for the High 
Anxiety group. In four of the seven compari- 
sons, the difference between Low Anxiety and 
High Anxiety groups is significant beyond the 
05 level of confidence. 

The extent of the difference between Low 
Anxiety and High Anxiety groups is most ap- 
parent for the relationships of E, I, and M 
with overt aggression and for the relationship 
of fantasy aggression with overt aggression. 
The direction of difference in favor of the 
Low Anxiety group is maintained for the re- 
lationships of E, I, and M with fantasy ag- 
gression, but to a lesser degree. Thus, differ- 
ences in construct validity which are depend- 
ent upon the population difference in degree 
of anxiety about aggression are clearly dis- 
cernable for the relationships between non- 
overt (Picture-Frustration and TAT) and 
overt (near-sociometric) measures of aggres- 
sion and are less discernable for relationships 


Gerald S. Lesser 


among the nonovert measures (Picture-Frus- 
tration and TAT) of aggression. 

The intercorrelations among E, I, and M 
measures, which appear in Table 1, do not 
Possess the same status as independent com- 
parisons that the intercorrelations between 
either E, I, and M and the measures of overt 
and fantasy aggression Possess. The closed 
nature of the scoring system for the Picture- 
Frustration responses automatically demands 
negative correlations among E, I, and M, 
since these three measures have only 2 df. 
That is, a high E score will automatically be 
accompanied by a low I score, a low M score, 
or both. Positive validity results require nega- 
tive correlations between E and I and be- 
tween E and M. Such negative correlations 
are demanded equally for both the Low Anx- 
iety and High Anxiety groups. However, the 
negative correlations between E and I and 
between E and M in Table 1 are greater for 


the Low Anxiety group than for the High 
Anxiety group. 


Discussion 


state that Population differences may have 
. Differences in va- 


S study indicate that the 
and overt measures of ag- 
e easily demonstrated for 


validity of nonovert 
gression can be mor 


a group of boys who have low anxiety about 
aggression. The population difference in anx- 
iety about aggression produces greater vari- 
ability or inconsistency between nonovert and 
Overt measures of aggression than among non- 
Overt measures of aggression. 

Certain limitations of the present study are 
apparent. The population difference in anx- 
iety about aggression was measured indirectly 

y means of information concerning the in- 
hibitory socialization attitudes and practices 
indicated by the mothers of the Ss, Although 
there is substantial evidence in other re- 
searches that anx 


duced by inhibitory socialization of aggres- 


sponses which 


correlations for the High Anxiety group were 


u attenuation in range of 
aggression scores for this group. 


Summary 


_ The results of this study suggest that it is 
maccurate to describe Measures of person- 
ality as valid or invalid in a general or over- 
all sense. A single Personality measure may 
Possess different degrees of validity for dif- 
ferent Populations, 


_ The hypothesis tested is that under condi- 
tions of high anxiet 


i nxiety about aggression. 

nxiety about aggression was measured by 
assessing the inhibitory socialization behavior 
of the mothers of 10- to 13-year-old boys. 
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es obtained from three techniques for 
ae ‘suring aggression in the boys (Rosen- 
a Picture-Frustration Study, a modified 
a T, and a near-sociometric measure of overt 
8gtession) were intercorrelated. 
agon datercorrelations among the measures of 
AN were greater (in the direction in- 
à ee] greater validity of the measures) for 
prec of boys with low anxiety about ag- 
anxiet n than for a group of boys with high 
Bien about aggression; for four of the 
tei; ee this difference was sta- 
the Pi y significant. Also, correlations among 
digg ee ation scores themselves in- 
the Lo greater validity of these measures for 
Ris a, Anxiety group of boys than for the 
igh Anxiety group, 
e cape demonstrates that, in validation 
fr the more exact specification is required 
which. determination of conditions under 
an 5) Consistency among various aspects of 
La dirt responding may be expected and the 
consi ions under which no consistency Or M- 
Stency may be anticipated. 
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EFFECTS OF VERBAL AND NONVERBAL 
REINFORCEMENT IN THE RORSCHACH 


LEONARD R. GROSS2 


Veterans Administration Hospital, Roanoke, 


While there is some awareness of the dy- 
namic interactions between examiner (E) and 
subject (S), the Problem of just how and to 
what extent test results are influenced by 
these interactions have not been fully ex- 
plored. It has been demonstrated that Ror- 
schach responses can be influenc 
entational sets stemming 


Roanoke, Virginia, Ve 


terans Ad Se ears 
for their guidance ministrai 


and assistance, 


Virginia 


Method 


The Ss were selected from the psychiatric 
section of a university hospital on the follow- 
ing bases: (a) no history of organic brain 
damage, (b) a minimum of tenth grade edu- 
cation, and (c) no Previous Rorschach ex- 
perience. They were randomly selected from 
both the inpatient and outpatient services 
and placed in one of three groups in the fol- 
lowing prescribed order: verbal reinforcement 
group (VR), nonverbal reinforcement group 
(NVR), or control group (C). i 

The Ss were excluded from the study if 
they did not meet both of the following cri- 
teria: (a) give at least one response involv- 
ing general human content (humans, human- 
like creatures, human anatomy) during the 
first two cards, and (b) give three responses 
per card for all ten cards. 

Out of the 46 Ss tested, 6 did not meet the 
criterion of three responses per card, and 10 
failed to produce one human response within 
the first two cards, leaving a total of 30 SS: 
with 10 Ss in each group. The mean age of 
all the Ss was 34, with a range of 17 to 53- 
The sexes were evenly divided. The diagnoses 
Were mixed and included neurotics, character 
disorders, and psychotics. The mean level of 
education for the 30 Ss was the twelfth grade, 
with 11 Ss having some college education- 
There were no significant differences in edu- 
cational level among the three groups. 

The Ss were presented with the complete 
set of Rorschach cards in the standard pro” 
cedure for the free association with one varla- 
tion in the Beck instructions, i.e., the inclu- 
sion of a sentence requesting three responses 

er card. 
, In the VR group, the E said “good” a 
each general human response. In the NV 
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fee the E nodded his head once after each 
ts Tesponse. In the C group, the cards 
= administered with the attempt not to 
oller any cues, 

me test interviews revealed that none of 
t e Ss verbalized any awareness of the na- 
ure of the study. 


Results 


a mean number of general human re- 
s a were compared for the three groups. 
Suar result of heterogeneity of variance, a 
raw € root transformation was applied to the 
Scores of the individual Ss. The means 
Well variances of the transformed scores as 
as the raw scores are found in Table 1. 
Sin analysis of variance of the transformed 
res for the effect of reinforcement yielded 
Were Significant at the .06 level. The groups 
individ ared with each other by means a 
as th ual z tests. One-tailed ¢ test was use 
€ direction was previously specified. The 
the poe gave more human responses than 
The woe at the .05 level of significance. 
SPons VR group yielded more human i 
Sion’ than the C group at the 02 level 0 
tao The VR and NVR groups did 
differ significantly from each other. 


Discussion 


tegos, results suggest that nodding or says 
seleen will increase the frequency of ES 
Situ ed content responses in a Rorsc 
er 
.2€ first two hypotheses that the 
aaa eas good and the nonverbal ee 
rel ding will increase the frequency of the 
as oe responses appear to be substan A 
ti The third hypothesis that the ver al 
ENE will be more effective than the no b 
S Tha] stimulus in increasing the peintre 
sponse is rejected. The latter result Ha 
ha with previous studies using zone z 
eg (Taffel, 1955). A possible explanatio. > 
at the use of a flashing light as 2 nonver' 
Teinforcer in other studies was not perceive 
wa Part of the testing situation, while nodding 
Was, 
is = most obvious implication of 
Un at one cannot discount even 
Conscious cues of the Æ when ana 
°rschach protocol. It follows that interpreta- 


the verbal 


the results 
minimal or 
lyzing a 


Table 1 


Raw and Transformed Scores of the Three Groups 


Square Root 


Raw Scores Transformation 
Group Mean Var. Mean Var. 
VR 8.7 11.34 2.86 32 
NVR 10.3 27.12 3.09 59 
CG 6.3 6.77 2.39 33 


tions of test responses and test behavior 
should not be considered separately but in 
light of the total situation. Both the E’s be- 
havior and the S’s conception of the testing 
situation are of import. 

While the results in this study are sugges- 
tive of some of the variables involved in the 
complicated interaction between tester and 
testee or interviewer and interviewee, it re- 
mains for future research to make experi- 
mentally clear other variables operating in 
such situations. It is probable that other as- 
pects of Rorschach responses can be rein- 
forced in a similar manner, but exactly which 
responses occur in sufficient number to be re- 
inforced as well as how much of a variation 
in E behavior is necessary to produce a 
change in a response level has not been an- 
swered. Another question is just how impor- 
tant are the variables that can be affected. It 
seems that if classical scoring methods are 
used these variables can have considerable 
effect on the dynamic picture. 


Summary 


The main interest was interpersonal rela- 
tions in a clinical situation. The study was 
designed to test the general hypothesis that 
E-S interaction is an important variable in 
test results. Thirty psychiatric patients were 
randomly selected and administered the free 
association of the Rorschach with the stand- 
ard instructions modified so as to elicit three 
responses per card. The Ss were then pre- 
sented with either verbal reinforment good, 
nonverbal reinforcement nodding, or no rein- 
forcement, whenever they gave a general hu- 
man content response. It was found that both 
the VR and NVR groups gave significantly 
more of the reinforced responses than the C 


Table 1 


Simple Intercorrelation Among Scoring Categories 


(From Wittenborn, 1950a) 


No. Symbol 1 2 3 4 5 6 7 8 9 10 il 12 13 14 15 16 17 18 
1 wW 
2 D —194 
3 d —228 669 
4 Da —138 608 749 
5 S —143 464 512 660 
6 M —041 498 560 665 616 
7 FM —058 625 429 381 288 359 
8 m 115 403 351 297 287 379 375 
9 K 255 330 246 259 155 269 281 425 
10 FK 203 275 238 221 232 154 201 240 LL. 
11 F —052 693 705 762 635 438 285 202 147 198 
12 Fe 100 587 583 605 519 579 326 450 349 153 460 
13 c 144 138 116 108 097 113 136 182 310 193 108 191 
14 Ga 016 466 510 503 508 532 345 468 310 114 377 546 076 
15 FC 023 541 429 457 374 342 361 563 181 028 305 571 —084 464 
16 CF 410 241 090 114 —008 —108 —025 113 353 285 179 117 251 089 133 
17 ¢ 170 178 072 137 066 —020 075 098 259 270 039 098 261 109 177 235 
18 P —095 208 266 163 034 177 221 363 198 —005 025 357 187 206 356 —033 216 
19 (6) —011 436 570 579 565 624 303 456 305 135 415 646 181 379 550 046 172 659 
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Table 2 


Partial Intercorrelations of Rorschach Scoring Categories 


(R Held Constant) 


No Symbol 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 
i W 
2 D —582 
3 d —486 —064 
4 Dd —370 —383 309 
5 S —250 —163 088 380 
6 M —128 —150 139 341 386 
"d FM —138 295 —051 —192 -—090 —009 
8 m 081 —041 —042 —180 001 114 135 
9 K 239 —109 —160 —171 —141 —001 044 277 
10 FK 183 —132 —103 —162 007 —117 —025 073 297 
11 F —210 —028 215 324 326 —134 —362 —337 —358 —186 
12 Fe 049 —110 062 068 167 241 —152 179 069 —178 —249 
13 c 129 —071 —061 —089 —025 —013 029 103 255 131 —079 077 
14 ie —042 —045 152 113 268 285 037 280 098 —123 —123 264 —038 
15 FC —038 072 —055 —038 037 —040 033 398 —095 —257 —327 273 —248 210 
16 CF 404 —080 —266 —257 —258 —415 —269 -046 254 189 —126 —159 204 —107 —066 
37 C 154 —041 —170 —079 —087 —212 —069 -011 185 205 —238 —089 227 —017 058 177 
18 P =115 %2 195 017 —099 077 140 316 132 —084 —211 324 156 125 309 —099 182 
19 (6) —075 —121 268 270 353 427 —025 263 082 —096 —048 434 089 108 337 —162 060 678 
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Table 3 
Simple Intercorrelations Among Rorschach Scoring Categories 


(From Wittenborn, 1950b) 
No Symbol 1 k 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 
1 Ww 
2 D 342 
3 d 191 638 
4 Dd 084 410 655 
5 S 261 339 305 34 
6 M 281 437 270 281 179 
7 FM 282 513 270 318 060 480 
8 m 296 306 395 512 245 135 294 
9 k 140 222 187 105 347 011 —098 131 
10 K 470 507 519 413 234 245 299 267 073 
11 FK 239 313 239 357 319 378 196 181 123 275 
12 F 349 727 741 693 483 129 248 421 222 505 230 
13 Fe 076 249 279 302 196 146 239 293 013 129 199 179 
14 c 437 424 545 403 286 125 102 363 160 458 187 475 100 
15 CG 337 481 508 323 9 211 241 219 059 380 260 354 165 453 
16 FC 335 588 378 313 292 342 436 309 176 224 278 356 289 389 430 
17 CF 513 509 592 345 250 225 147 153 283 507 203 464 105 549 581 401 
18 Cc 419 249 304 189 104 058 019 331 047 235 O14 319 034 445 149 O4 261 
19 P 063 096 000 —125 075 094 029 —093 —004 —039 109 003 —031 006 008 031 —106 009 
20 0 210 211 135 119 484 085 123 275 046 155 113 300 120 200 135 349 018 —006 235 
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Table 4 
Partial Intercorrelations Among Rorschach Scoring Categories 


(R Held Constant) 

No. Symbol at 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 
1 Ww 

2 D —313 

3 d —304 —111 

4 Dd —400 —435 329 

5 S —001 —227 —126 OAL 

6 M 069 138 —100 006 —O41 

7 FM 026 189 —191 —002 —242 342 

8 m 064 —248 068 312 021 —O81 083 

9 k O18 032 O11 —063 273 —103 —253 024 

10 K 218 —O71 107 035 —094 —021 —001 —023 —091 

11 FK 068 018 —043 185 181 270 030 023 045 086 

12 F -270 —162 241 349 128 —546 —421 037 037 —056 —155 

13 Fe —900 007 105 165 069 030 121 192 —057 —054 113 —134 

14 c 189 —207 199 052 006 —162 —254 132 031 168 —016 —056 —077 

15 c 070 010 173 —042 —120 058 037 —046 —083 076 091 —281 016 205 

16 FC 022 153 159 —123 —006 117 201 040 045 —222 092 —423 156 065 155 

17 CP 265 —1s1 206 —116 —097 —072 —255 —215 177 193 —026 —245 —100 285 363 024 

18 C 289 —1š1 050 —060 —090 —114 —195 199 —O41 023 —127 015 —075 310 —059 —231 043 

19 P 061 164 —025 —182 075 094 022 —116 —009 —065 109 —030 —039 —007 —004 023 —155 001 
20 (0) 067 -104 —144 —096 408 —048 —026 163 —025 —030 012 095 041 041 —030 227 —232 —124 240 
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Fig. 1. Frequency distribution correlations before and after partialling 
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Reply to Glickstein 


i ee effect becomes less important 
Eaire the number of mutually exclusive 
ine he = intercorrelated, which can be seen 
tion sewer matrices of partial intercorrela- 
relations “a 2 and 4). The pooled partial cor- 
in tke ty etween the five location categories 
= 195 a em) have a median value of 
din Gee 15 of these 20 values negative. 
sient e shows this negative tendency to 
futher at beyond the 025 level. The 
categorie h determinant scores, in which the 
humerous Le mutually exclusive but more 
~ 001 S, have a median intercorrelation of 
cantly pa these partials are not signifi- 
iele e This problem of deflation of 
is, of in by mutually exclusive categories 
of parti rse, not resolved by the procedure 

rtial correlation. 
confidenc Considerations severely limit any 
e in the resultant factor structure. 
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The general inflation of the entire matrix by 
a variable R would be reflected in spuriously 
high communalities. The mutually exclusive 
categories would artificially decrease the cor- 
relations among some variables and not 


others. 
Received February 10, 1958. 
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SOME COMMENTS ON 
AMONG R 


CONFOUNDED CORRELATIONS 
ORSCHACH SCORES 


j. R WITTENBORN 


Rutgers University 


they Stein has indicated that he believes 
Rorsch? the total productivity score oP the 
Schach, influences the correlation between 
comn Rorschach scores in the manner a a 
He pies third variable (Glickstein, 19 pi 
Which en proceeds to examine the bi = 
ect, this putative common third varia e 3 
in S intercorrelations among Rorschach ae 
WE categories; he does this by holding te 
ariance of R constant through the device of 
Partial correlation. He finds that a substan- 
‘al portion of the resulting partial correla- 
fe carries a negative sign. He then ascribes 
J€ preponderance of negative partial correla- 
tions to the fact that Rorschach scoring pro- 
cedures involve the use of a “small” number 
Of mutually exclusive categories. After assum- 


ing that R inflates all the intercorrelations in 
the manner of a common third variable and 
after further assuming that the intercorrela- 
tions among the scoring categories are simul- 
taneously suppressed by the mutually exclu- 
sive qualities inherent in the Rorschach scor- 
ing procedure, he concludes that confidence 
in the result of factor analytic studies of Ror- 
schach scoring categories must be severely 
restricted. 

The writer’s views concerning the nature 
and significance of the R variable are dif- 
ferent from Glickstein’s. The number of re- 
sponses in the various scoring categories de- 
termines R, and R does not delimit the num- 
ber of responses in any scoring category; 
accordingly, the writer does not consider it 
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useful to regard R as a common third vari- 
able. R is generated by the number of re- 
sponses in the various scoring categories, and 
the writer shares the interpretation of Coan 
(1956) and of Stotsky (1957) who see the 
relationship between any response category 
score and the total productivity score, R, as 
a part-whole relationship. With this inter- 
pretation, partialling R from the correlations 
between Rorschach scoring categories would 
be something like partialling the total score 
on a test from the correlations between the 
subtest scores or like partialling the full scale 
score on the WAIS from the intercorrelations 
among the various subtests. The writer does 
not have any questions about the Rorschach 
or any other test which require this kind of 
statistical exercise, but he suspects that such 
a partial correlation procedure would yield 
Many negative partial intercorrelations among 
the WAIS subtests, just as it was found to 
yield negative partial interc 


orrelations among 
Rorschach categories, 


from the correlations by 
tion procedure. In view 
difficult to ascribe any g 


J. R. Wittenborn 


the fact that many of Glickstein’s partial cor- 
relations are small and negative. 

The writer’s interest in the Rorschach 
method was generated by clinical use, and 
during the 1940’s several studies were under- 
taken for the purpose of exploring some of 
the assumptions which were explicit in the 
method or were inferable from standard pro- 
cedures (Wittenborn & Sarason, 1949; Wit- 
tenborn: 1949a, 1949b, 1949c, 1950a, 1950b; 
1950c; Wittenborn & Holzberg, 1951). At 
that time it was recognized that the nature 
and the distribution of some of the variables 
do not always meet the exact requirements 
of some of the statistical procedures em- 
Ployed, e.g., “Since the present investigation 
is concerned with the Conceptual implications 
of the Rorschach Scoring procedures, it was 
decided to study the scores directly with 
whatever imperfections they may possess a0 
not attempt Statistically to refine them 0 
their intercorrelations” (Wittenborn, 19508: 
Pp. 263-264), 

When the study from 
draws his dat 
sized that the 
in such a way 


of productivity, Total numb 
R, was left in the m 


which Glickste!” 
a was planned, it was hypothe 
Scores would be intercorrelate 


er of responses 
atrix in order to identify 
vity and indirectly to £4” 
ation of other factors. TPE 


vestigators using 
Williams & Lawr 
that R, the tot 


? 


ence: 1953, 1954), The fac’ 


as been recognized by mos 
nd some of them have elimi 
torting effect of R on fact? 
eliminating R from the tot? 
relations (Coan, 1956; Stotsky 
Coan and Stotsky explicitly reg 
he nature of the Rorschach pro" 
e generates varieties of confoun! 

he Rorschach variables, and thé 
have been resourceful in attempting to co” 
trol these effects in their analyses. 


x To describe some of the intercorrelation® 
et 


investigators, a 
nated this dis 
Patterns by 

matrix of cor 
1957). Both 
ognize that t 
cedure per s 
ing among t 


Ween Rorschach variables as spurious } 
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h 
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Correct from the standpoint of the statistical 
denotation of the word spurious, but so nam- 
ing this effect does not reduce it or make the 
various sources of confounding any less real 
or make R a less useful part of the Rorschach 
method of personality analysis. At present, 
one has the unhappy choice of studying the 
„Morschach “as it is,” of studying it “as it 
‘sn’t,” or of ignoring it altogether. Perhaps 
Someone will soon devise a new procedure 
Which will incorporate the merits of the Ror- 
Schach and eliminate some of the intricacies 
mng confounding which make its proper sta- 
tistical study so forbidding. 


Received October 20, 1958. 
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THE SELECTION OF THE MENTALLY DEFICIENT 
FOR VOCATIONAL TRAINING AND THE EFFECT 
OF THIS TRAINING ON VOCATIONAL 
SUCCESS? 


LAWRENCE COWAN anp MORTON GOLDMAN 


University of Kansas City 


The problems of the mentally deficient 
have recently undergone a period of exten- 
sive examination. One of these problems that 
is receiving the most stress at this time is 
in the area of vocational adjustment (Engel, 
1950). The present study examines the rela- 
tionship of training to this vocational adjust- 
ment and explores several criteria that could 
possibly be used to predict the success or 
failure of the mentally deficient in achieving 
this adjustment. 

Some authors (Engel, 1950; Keys & 
Nathan, 1932) have expressed the opinion 
that training is of questionable value for the 
mentally deficient unless it is specially fo- 
cused toward a definite job. However, the 
sheltered workshops available in some com- 


munities, giving a more global type tr 
with awareness of f 


limited by the com 


retarded and defici 
cational training 


other than 
intention of 
these other 

1 This paper is a condensation of a dissertation 
(Cowan, 1957) submitted to the Graduate School of 
the University of Kansas Ci 


ty by the first author, 
The second author served as advisor. 


“matched nont: 
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places of training can adequately prepare the 
mentally deficient for eventual job placement. 
If this is so, then the community will have 
other resources to expand in helping the men- 
tally retarded and deficient to receive voca- 
tional training. 3 

The first hypothesis (Hı) this study ex 
amines is: The mentally deficient, as a rê- 
sult of vocational training, will be able t0 
get and keep a job more successfully than 4 

rained group. This hypothes!s 
may seem somewhat naive, since one is 1- 
clined to think that any trained person woul 
be more successful than one not trained i? 
getting and keeping a job. But this is not 
necessarily so, for at one time it was thought 
that the jobs a mentally deficient perso? 
could do were so simple as to warrant rO 
training, and, if training were given, it woul 
not appreciably benefit that individual (Engel, 
1950). 

The second hypothesis (H 
examined is: The ability to get and keep @ 
job for the mentally deficient (IQ level 40- 
79) varies directly as the IQ level. 

The concepts of intelligence and IQ have 
of necessity undergone many changes in em 
phasis during the Past years, swinging from 
no credence placed in the terms to attempting 
to adjust an individual’s educational and ve 
cational development by using the sie 
gence quotient.” Fortunately for many, en 
use of the IQ score has shifted back towar 
the middle of these extremes. There is ti 
area, however, that has been noticeably ee 
in using a more operational concept of inte ĝ 
gence—this has been in the vocational oe 
seling of the mentally retarded and deficient: 


2) that will be 


ON (O 
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It j 
that tere perhaps more than anywhere else, 
should be Q score has been “glorified.” It 
books an A ee out that most professional 
Counselin articles in the field of vocational 
against ii ai the mentally retarded warn 
Placing the pting the IQ score as categorically 
aci Moe a ial into a class of potential 
is continual] (Mausner, 1953). This warning 
Cidence of y being voiced due to the large 1n- 
of workers doing just that. It is com- 


Mon to 
Opinion zo vocational counselors with the 
divia at given two mentally deficient in- 


u h 

other as with a tested IQ of 55 and the 
higher T 
Just 


an IQ of 75, the one with the 
ear il make a better vocational ad- 
e Gia to the difference in IQ points! 
With the ird hypothesis (Hs) is concerned 
Which a examination of several other factors 

re purported to play a direct role in 


Predict; 
tional S Vocational success. It states: Voca- 
from effort 


job, formal 
ence. A VO- 
t make a 
mentally 
him for 
es the in- 


ade pe can be predicted 
E cation ee Pting to locate a 
tational aand past work experi 
judgment., habilitation counselor mus 
deficient as to the potential of the 
Services we prior to accepting 
ormation . doing this he always us 
2 Counsel available. It seems reasonable that 
Made little r might consider a person who has 
aving ike or no attempt to find a job as not 
S exert oe potential that one vi 
Counselor more effort will have. Further, the 
ion achi might think that the more educa- 
cess, ic a the better the chance for Sut 
vidual hag he might think that if the indi- 
$ etter a some work experience, he will make 
The w adjustment to training on a new job. 
that hii history is probably the one factor 
Selor, torn important to the voca 
© can h it is here that the coun 
Client, ano discover the adaptabi 
the coun these factors taken as 2 W y 
the i selor an opinion as to the potentia 
individual for vocational suc The 


sc cess. 
~~ Scor j s 
€ and the case history, which 


ive him 
Informat; give hi 
mation of the nature stated in the third 


decision as 


Pothes} 
esis, are used to arrive at 4 n as 
tation 


to 
Pi sas the re is a “reasonable expec 
habilitat individual can be vocationally re- 
J tee ei is true that these factors of 
rately þ history, etc. are never taken sepa- 
ut are examined in relationship tO the 


total picture of the individual. It is the au- 
thors’ view that, regardless of the attempt to- 
ward a total picture, this picture will not 
yield reliable information because the criteria 
used may not be valid. If the value of train- 
ing of the mentally deficient is to be judged 
by vocational counselors, it might be neces- 
sary for them to re-evaluate their criteria. It 
may be that techniques of making decisions 
which relate to the advisability of training 
the mentally deficient will need to be ad- 
justed drastically as more up-to-date infor- 
mation becomes available. 


Method 


As a first step, the files of a district office 
of vocational rehabilitation ° were sorted for 
all the mentally deficient clients given train- 
ing since the agency opened its office in 1952. 
These individuals constituted the experimen- 
tal group. Those persons who were referred 
with mental deficiency plus a physical handi- 
ruled out since the physical aspects 
of their disability would contaminate the re- 
sults of the study. When this sorting was 
complete, there were 22 individuals who met 
the requirements of the experimental group, 
that is, mentally deficient (congenital defect) 
with no accompanying physical disability, 
who received vocational training. Twenty were 
available for the complete work-up; the other 
two had moved from the city after they had 
received their training. The borderline upper 
limit of retardation or deficiency in IQ as 
stated by Wechsler (1944) was used as an 
upper cutoff score, that is, an IQ of 79. Since 
no individual with an IQ of less than 40 was 
accepted for training, this constituted the 
lower limit. 

A questionnaire was developed to use in 
the follow-up interview of this study. It was 
designed to yield the following information: 
name, age, Sex, race, education, referral 
source, IQ, date of IQ testing, date of con- 
tact, type of training, where training was 
given, and for how long. If employed since 
the time of training, information was ob- 
tained as to what type of employment, for 
how long the job was held, and how the job 
was obtained. 

2The Office of Vocational R ilitati 
er air chabilitation, Kansas 


cap were 
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When this information was gathered on all 
20 cases, a comparable group of mentally de- 
ficient individuals was taken from the files of 
a private rehabilitation agency to correspond 
to the experimental group. These people were 
selected on the same criteria as the first group 
from a total of 53 cases. Twenty people were 
selected who matched the experimental group 
as closely as possible on Sex, age, education, 
race, IQ, and past employment. The major 
difference between these groups was that the 
second group (the control group) had re- 
ceived no vocational training, whereas the 
first group (the experimental group) had re- 

ceived vocational training. These individuals 
in the control group were referred to the pri- 
vate rehabilitation center for IQ tests.? These 
same people had never heard of the Office 


, and they were 
e to Vocational 
own about the 
ir answers were 
assumed that the 
between the con- 


Also, the mothers of all the sub- 


S) were interviewed in order to avoid 
the Possibility that the individu i 


the experimental group 


4.15; the correspond- 
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ing scores, in the same order, for the control 
group were 22.9, 61.2, and 5.15. The differ- 
ences between the standard deviations of these 
Corresponding measures were small, The mean 
time that elapsed between time of testing and 
contact for the experimental group was 3.1 
years and for the control group was 2.7. And 
finally, the number of cases with no past work 
history was 12 for the experimental group and 
the same number for the control group. 2 
The 40 cases (20 in control and 20 1 
experimental) were interviewed to discover 
What had transpired since the time of train- 
ing for the experimental group and since the 
time of testing for the control group. Infor- 
mation was obtained as to which individuals 
had secured employment and how long they 
had remained employed, whether those em- | 
ployed of the trained group had found jobs 
in the area of their training, and whether they 
had been successful jn making a vocationa 
adjustment. An adequate vocational adjust 
ment was said to exist if the individual ha 
held a paying position for at least 12 months: 


least the minimum’ 
he state * and wa 


Results 


After all questionnaires were completed, the 
data was combined and yielded the following 
over-all information: Of the 20 experiment 
cases (those receiving vocational training), ! 
were employed at the time of contact and had 
been in that status for at least one year. They 
were receiving an adequate income as define 
in the preceding Paragraph. All 12 of thesé 
cases were placed in their jobs by the voca 
tional counselor.’ The successful group col” 
sisted of 9 males and 3 females which corre- 
sponds identically with the three to one rati? 
of males to females in the total group (1 
males, 5 females). The mean age of the suc 
Cessful group was 21.75 years which does not 

*In this case, $1.00 per hour. 

5 The implications of this will be discussed below: 
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E Table 1 Table 2 
ffect of Training on Vocational Success TQ of Successful and Unsuccessful Subjects 
S = 
fetus Trained Untrained Total Subjects x n s 
Un 
Renn” 8 16 24 IQ of successful, trained 639 12 92 
yed 12 4 16 IQ of unsuccessful, trained 66.0 8 9.0 
Total IQ of successful, untrained 61.0 LT 3% 
$ 20 20 40 1Q of unsuccessful, untrained 61.2 16 84 
Note. —. 


2 = 
X? = 8.437 (corrected for continuity); ? < 001. 


Vary si 


the gr Snificantly from the total mean age of 


oup (20.8 years). 

s e criteria for assessing vocational 
Ose were applied to the control group 

Cases one no training). Of these 20 

adjustm had achieved a successful vocational 

elation ent. To test the significance of the 
i-s ee of training and employment, the 

Used are test (corrected for continuity) was 


Table T he results of this test are showa ™ 


T 
abe be seen from Table 1 that the prob- 
alone ior, these results occurring by chance 
thousand. 


® is less than one out of @ 
signifier sults were considered to be highly 
o ant, and H; is supported. = 
vidua] test Ha, the mean IQ of those indi 
a just who achieved a successful vocations 
the „oent in both groups was compared wi 
Btoups on IQ of those in their respective 
Ps who were unsuccessful. Table 2 shows 
Mean and standard deviation of the IQs 


3 in each 
Stoup successful and unsuccessful Ss 1 


When the means were submitted to the £ 


test, i 

a was discovered that the be 
veen t he succe: 

tr he mean IQs of the S's did not 


ained i 
Va and the unsuccessfully tra 
tY sufficiently to warrant the statement te 


Y were f P lations. 
ro; t populat! 
m different P Pa sans Of 


to state they 
other 


o; Eos ae 
* Untrained group were not statistically S18 


icant, F: 5 between the 
Si . Further, the differences De 
Uccessful in both groups aS compared to the 

t signifi- 


Successful in both groups were no 


6 
0: For all statistical methods used in this study, the 
level of confidence will constitute significance. 


cant, These findings then do not support He. 
In the statistical examination of the third 
hypothesis, it was necessary to test each of 
the three factors separately. The first factor 
examined was formal education. Table 3 shows 
the mean level of education in terms of grades 

and the standard deviation for the groups. 
The means were submitted to the ¢ test and 
the findings were: The difference between the 
means of educational level of the successfully 
and the unsuccessfully trained was not sig- 
nificant at the 05 level. The same results 
were found for the difference between the 
f education of the untrained 


mean level 0 
group. The difference between the means of 


the successful and unsuccessful Ss, irrespec- 
tive of training, was submitted to the # test, 
and the difference was also not significant at 
the .05 level. 

The factor effort exerted to find employ- 
ment was examined next. One point was given 
to an S for each attempt made to find em- 
ployment. Comparing the median effort ex- 
erted by each group showed that the trained 
a median effort of 1.09, and the 
group had a median effort of .50. 
The median test was used to test for signifi- 
cance. It showed that the difference in effort 


Table 3 


Level of Education for the Successful 
and Unsuccessful 


Subjects X n A 

Level of education of successful, 

trained 492 12 41 
Level of education of unsuccessful, 

trained 3.00 8 34 
Level of education of successful, 

untrained 6.75 4 309 
Level of education of unsuccessful, g 

untrained 495 16 47 
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between the trained group and the untrained 
was highly significant (p < .001). However, 
it must be pointed out that to receive train- 
ing it was necessary for the trained group to 
go to the Office of Vocational Rehabilitation. 
This automatically gave them one point for 
effort. Since the combined median of both 
groups was .93, all the Ss in Group I were 
over the median. This accounted for the high 
significance in the trained group. This sta- 
tistical test thus supports the aspect of H, 
that states effort is indicative of vocational 
success. 

The third factor of Hz examined was the 
relationship of work history to vocational suc- 
cess. Since the two groups were matched for 
the number having previous work experience, 
the support of H, established the fact that 
work history was not pertinent. Each group 
had 12 Ss who had past work experience. 
What remained to be explored was whether 
those individuals in each group who achieved 
vocational success consisted of a Statistically 
significantly higher number who had had past 
experience. In each group, the number of 
persons with past experience was identical to 
the number without. For the 12 successfully 
trained, 6 had had Past experience and 6 had 
not. These results indicated that there was 
no difference between having had or not hav- 
ing had past work experience and achieving 
vocational success. This finding, then, did not 
Support the third factor of Hy. 

The final result of the study examined was 
the length of time between the time of IQ 
testing and contact. Tt already has been 
stated that this time for each group was 
averaged, yielding a mean elapsed time for 
the training group of 3 years, 1 month. The 
elapsed time for the control group was 2 
years, 7 months. If the average time spent in 
training for Group I (4.8 months) is sub- 
tracted from the average time elapsed for this 
group, a corrected figure of 2 years, 9.2 


months is reached. This constitutes the time 
available for Group 


I to find employment, 
When these figures were compared to the 
mean time elapsed for Group II to find em- 
ployment (2 years, 7 months), it was found 
that both groups had approximately the same 
length of time available to achieve vocational 
success as defined here. 


Discussion 


The primary concern of this study is the 
relationship of training to the vocational suc- 
cess of the mentally deficient. The results of 
the statistical analyses in the preceding sec- 
tion indicates that those receiving training 
made a better vocational adjustment than 
those who did not. When the variations of 
TQ, age, education, etc. were controlled, the 
results were still the same. Training made the 
difference. But training to the mentally de- 
ficient means more to them than just an op- 
portunity to learn new skills. It means that 
someone is interested in them, someone }§ 
there to encourage their efforts and to help 
them handle the disappointments and frustra- 
tions that arise, They may not have receive! 
this support at home. Under a healthier at- 
mosphere the mentally deficient, as well a5 
anyone, can and will learn more and produce 
more. This brings us to the subject of the 
home life of the mentally deficient and how 
it relates to vocational adjustment, Talking 
with the mothers of these 40 cases brought t0 
light some interesting differences between the 
two groups. These differences were not objec 
tively measured in this study, but they man’ 
fested themselves too frequently to be ig 
nored. In talking to the mothers of the cases 
in the control group (no training), it w35 
commonplace to hear them say, “John can't 
work, he’s not bright enough. Everyone woul? 
take advantage of him, He couldn’t get along 
by himseli—he’s much better off here at home 
where I can watch him, Oh, yes! He does p 
lot of work around the house.” This quotatio” 
is a composite of remarks from several mot!” 
ers, but it represents the general feelings hel 
by the mothers of Ss in this group. This att 
tude on the part of the mother may have 
Come after John showed no inclination fo" 
outside work and was used defensively by th® 
mother. It may have come before John war 
old enough to work and represented the pr 
tective shield that had surrounded him all bis 
life. Either way, however, he is receiving pe 
encouragement to accomplish on his own 0 
to prepare himself for the time when he may 
be on his own. It was striking to compare 
these attitudes with those of the mothers 0 
the group that received training. These moth- 
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hongi they had the same fears as the 
sible Eo, were working as much as pos- 
aahi, he rehabilitation of their sons and 
manif ers. This attitude might have become 
ome due to the abilities shown by the 
may “ny deficient in their training, but it 
environ morg. indicative of the nature of the 
aps Pe i which they were raised. Per- 
ageme: e attitude of helpfulness and encour- 
cept T results from parental ability to a 
and j e mentally deficient as an individua 
is e plies no attempt to push him beyon 
naa nor to shelter him to such an 
ered T his capabilities are never discov- 
me has been said in the literature 
ental] e need to accept the physically = 
Aa y disabled, but how does one accept 
rejected; aa Ehter who is unconsciously liaa 
Vidual ‘The answer of course 1 that t se 2 
far, , 18 not accepted. There 1S more pea 
Stan na edge between intellectual unge 
ng and emotional acceptance: m 
under, foregoing constitutes an attempt 


tstand ; f the men- 
t some of the problems O 
A A hese thoughts 


e, howeve!, 
t he 


m 


fan le i pcepesen reported on her: 
trained to some practical 
adjust group did achieve a bette 
30 iş sah than the ee 
traj SHl not too clear. Are tho c 
this 8 in a better position tO profit 
ser e Motionally, or does the training 
Eve], as a vehicle for the expressio EA R 
Need Oped abilities? This question F ae 
tabli for more experimental ev! e a 
ish the relationship of emotional 4e BRA 
e to vocational and social success: 
ent sults of this study, it appears 
fron tly deficient individuals W° 
of co onal training. 
equine be adjusted to © 
ajctitements of the individ gica 
Who had a healthy psychologi 


Sou) -ed effe 
e ld benefit from the combine. e a 


Ouraging atmosphere PIU 
‘aired, The mentally deficien 
ely immature and, aS |. The 
el Otionally immature aS well. 
in pendent upon their parer Ji 
8 program is to be effective, 
nsible for the training 
Ork with the parents: 


hat many 


e agency Te- 
also have to 


For along time now the relationship of 
tested IQ to job success has been known to 
be uncorrelated (Brainerd, 1954). The IQ 
test is an important tool in psychology, as 
well as in the field of education and counsel- 
ing, with the mentally deficient. However, 
using IQ scores as a predictive device for vo- 
cational success is not supported by the evi- 
dence in the present study. 

The formal education of the mentally de- 
ficient should also be given some attention. 
Like the IQ score, its use as a predictive de- 
vice for vocational success is not supported 
by the evidence in this study. 

Measuring the effort exerted by the Ss to 
find employment produced some problems. It 
was intended in using this measure to tap 
all methods of securing employment. One of 
the problems, thus, was to decide whether Ss 
in Group I (the experimental group), who 
were all trained and placed through the Olfice 
of Vocational Rehabilitation, should receive 
credit. Strictly speaking, making contact at 
the Office of Vocational Rehabilitation was 
an attempt to secure employment, and there- 
fore the Ss in Group I all were allotted at 
least one point. However, the question can be 
raised as to whether this method of obtain- 
ing employment was comparable to the other 
methods of finding a job used by the control 
group, Group II. In one respect the individual 
assumed much more responsibility by cooper- 
ating with the plans formulated with the vo- 
cational counselor, but he also does not have 
the problem of finding a job opening on his 
own. This was done for him by the vocational 
counselor or the placement service. Because 
of these difficulties in measuring the effort 
exerted in finding a job, it cannot be said that 
a relationship has been found in this study 
between the effort exerted in locating a job 
and ultimate vocational success. It might even 
be possible to assume that it was the job 
placement that accounted for the success of 
the trained group rather than training." 

In the experimental group, the group that 
received training, we note that 8 of the 20 
still remained unemployed. Our data shows 


7 A study is presently under way which will com- 
pare tas groups of Ss—one group given placement 
aid and training, the other group given o) 
ment aid. PADAS 
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that these “failure” cases cannot be distin- 
guished from the “successful” cases by IQ, 
age, previous education, sex, or previous work 
history. How then can we account for these 
“failure” cases? The answer to this question 
will, of course, demand much additional re- 
search. The study reported on here had too 
few cases and was not designed to explore 
this area. However, certain suggestions can 
be made. One area that might be examined 
is the personality of the trainee in combina- 
tion with the personality of the instructor, 
and the relationship established between the 
instructor and trainee. Another factor might 
be the type of training given and the demand 
that exists for people with this type of train- 
ing. And finally, of high importance would be 
the effort and ability of the placement coun- 
selor who works with the trainee trying to 
locate a position for him. 


Summary 
ae This study dea 
training to the vo 
tally deficient, T: 
ficiency ‚with no 
ability who recei 
the State Depart 
tation were mate 
tally deficient i 
IQ, education, 
elapsed time sinc 

Administering 
Covered that the trai 


IQ level, formal education, or past work F 
perience. Since the trained group was place 
in their jobs by a vocational counselor, n 
results may be influenced by the placemen 
itself, which is an integral part of rehabilita- 
tion. The measurement of effort scale showed 
several weaknesses in operation, and no 4 
sumptions Concerning the relationship be 
tween effort and job success seemed feasible. 
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Th , 
Ae syel; en creasing number of chronic neu- 
i Gere patients represents perhaps the 

A Problem in the field of mental health 
the feld espite recent advances, notably in 
the iird, of chemotherapy and rehabilitation, 
thteateni = of the chronic population grows, 
facilitie ing to overwhelm existing hospital 
ae S and available professional person- 
ed as the first 
develop an 


ri 
toq, 


Step in. Study was conceiv 
inde, 2 three-part plan to: (a) 
p cee of chronicity; (b) attempt 
tonici and study the determinants of 
Kctivenc o and (c) develop and test the ef- 
the a of retraining programs based on 
Population S characteristics of the chronic 
1 bossibility of a predictive index was 
the p, by a study previously complet 
Hospit erry Point Veterans Administration 
ana ae (Giedt & Schlosser; 1955). An 
Ass for of the time sequence of discharge 
Slo, or the patient population revealed that 
during, êdmitted patients left the hospital 
‘ a the first 90 days, 25% durin 
nths, and only 2% during 
Months covered by the s 
index, based on demogtaP 
fae il the time 0 
n, would permit a compatls 


in 
dictive 

rist: 
'Stics f hospital 
on of the 


1 
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characteristics of the “quick discharge” popu- 
lation with the potential chronic population. 
In addition, it would facilitate the early, com- 
prehensive study of the potential chronic 
population so that the characteristics of those 
who finally did leave the hospital could be 
compared with those who remained indefi- 
nitely. Such an early study, before the level- 
ing effect of hospitalization on social charac- 
teristics and attitudes became operative, was 
deemed particularly desirable. 

The extensive literature (see, for example, 
Zubin, in press) on the prognosis of length of 
hospitalization was reviewed and the follow- 
ing variables selected for study: 


Number of previous hospitalizations 

Age at first neuropsychiatric hospitalization 

Age at time of current hospitalization 

Service-connection of disability (per cent) 

Length of military service 

Age entering service 

Months service prior to first NP hospitalization 

Education 

. Religion 

. Marital status 

. Number of children 

. Combat experience (Yes or No) 

z Neuropsychiatric diagnosis in service (Yes or 
No) 

. Diagnosis 

. Severity of external precipitating stress 

. Predisposition 

. Degree of incapacity 

. Secondary diagnosis (NP—Yes or No) 

. Legal competence (Yes or No) 

. Alcoholism (History of—Ves or No) 

. Occupational classification level 


pà 
O OR ETARA a 


m 
= 


ee 
as 


yee 
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w 
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Method 


Data for this study were derived from the 
clinical record folders of all male neuropsy- 
chiatric patients admitted to a large Veter- 
ans Administration hospital during the period 
from July 1, 1954 to December 31, 1954, 
With the exception of length of hospital stay, 
the criterion, all of the information used in 
the index was obtained from the initial psy- 
chiatric summary, which is completed within 
three weeks of admission, and from demo- 
graphic data which are recorded immediately 
upon admission. The final total sample for 
the 1954 period consisted of 248 cases. A 
small percentage (less than 5%) of the clini- 
cal record folders were unavailable because 
they had been transferred to other hospitals 
or because they were otherwise unobtainable, 
Where patients had been admitted more than 
once during the period, data from the first 
admission only were included in the sample. 

Information on the 21 variables that had 
been selected for study was recorded and the 
sample was divided into those who were hos- 


of incapacity, legal competence. 
ism. Marital stat i 


nection, differentiated the groups be 
.05 and .10 level of confidence. F 


eighth variable, occupational classification, 
significant beyond the .30 level, was retained 
in the original predictive index because of the 
special significance that has been accorde 
it (Frumkin, 1955). s 

A score for each item within the eight vari- 
ables was computed following a method de- 
vised by Moran, Fairweather, Morton, and 
McGaughran (1955). This method essentially 
involved computing for each item the prob- 
ability of a patient’s falling in the Long Stay 
group. The log of each probability value was 
then ascertained, Each patient was then as 
signed a score which was the sum of the 
eight log values that applied to him. 

Scores thus computed for all cases ranged 
from 5.75 to 2.25. Below an arbitrary cutting 
point of 4.25 were 75 cases. Of these, 85.3% 
were in the Short Stay group. Above a cut 
ting point of 2,75 were 89 cases. Of these 
85.4% were in the Long Stay group. This 
index, then, served to predict long or shor 
stay for 66.1% of the sample with a high de 
gree of accuracy. In addition, it allowed f0" 
the specification of those cases for which a 
curate prediction could not be made. j 
_ Prediction for this group of 1954 admis 
sions might have been spuriously high, % 
Course, since the index was constructed fro™ 
the very cases being predicted, Therefore, th? 


index was cross-validated on a sample of 19 
admissions, $ 


Cross-Validation 


Data were collected for all male neuropsy” 
chiatric patients admitted to the same hos 
pital during the period January 1, 1955 E 
June 30, 1955. The same scoring procedures 
and cutoff points were employed with this 
sample of 209 cases. Below the cutting pol? 
of 4.25 were 69 cases, Of these, 87.0% were 
in the Short Stay group. Above the cutting 
Point of 2.75 were 76 cases. Of these, 78.9% 
were in the Long Stay group. Thus the inde*: 
based on 1954 admissions, could have pre 
dicted length of stay for 69.4% of the 195 
admissions with 82.8% accuracy. 

In calculating the differential power of the 
individual variables on the cross-validatio® 
sample, it was found that three of the eight 
variables did not reach the .05 level of sige 


"7 


Predicting Stay in NP Hospital 


Probabilit; 
abilities of Long Stay Given by Each of the V 
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Table 1 
Jariables in the Revised Form of the Index 
Chi Probability 
Vari Square of Long Log 
M table N» p Cutting Points Stay Values 
arital sta 
atus 454 .001 Married and widowed 4o*  9.59988-10 
Separated and divorced AS 9,63548-10 
bi Single -66 9.81624-10 
lagnosi 
x 7 001 Organic 39 9.59550-10 
Psychotic .78* 9.89321-10 
Neurotic 30 9.48287-10 
D Character disorder .10 9.01703-10 
egre . 
ee of incapacity 445 001 None, mild, moderate = Hearty 
Severe ‘ .91169-10 
L Not part of diagnosis® 10 9,02119-10 
Cga 
Bal competence 444 001 Competent 33" 9,51983-10 
Incompetent 88 9,94498-10 
Al 
cohol 449 ool Yes 37 9,56585-10 
` .65* 9,81023-10 


Stay N 
Nees, differs 
diso, ; Tn the sT each variable because occasi 
rder te case used in the index is the log of the me 
ı Where thay Degree of Incapacity, “not part o 
is is not included in the formal diagnosis. 


onally informa 
m 


ifc 

Cay 

tion Nee, Thes . x 
e were: occupational classifica- 


e , Seryj 
he ien connection, and combat experi- 
Cludeq i ordingly, these variables were not 
Dh n the final, revised form of the index- 
e . 

Revised indes 


he 
te Anal form of the index 
ission tion of both samples, 

s during the period July 1, 1954 to 
iN Scores on the final form were 
Dey as tom the remaining five variables ex- 

tobabilit, the original form. The individual 
Riven ; ities furnished by each variable are 
i i Table 1. 

Shown ioe a each group 
ae € validity of this index, i€» 


was based on 
embracing all 


distribute as 


the relation- 


d long stay; 
ts selected. 


T 
t Wo 
me a e these variables, service 
me tally kor i were ones in whic! 
Ya Sto; igh number of “unknowns: 
voy 2 es a were assigned. It is sugges 
waving y l prove significant in future stu 
ke a ie erans where the data may 
this agen Em of precision than 
study. 


tion o! 


dal p valuc,© 
f al Anosis” refers to t 


No 


“unknown” for a particular case. In such in- 


hich is indicated here by an asterisk. 
notably alcoholism and personality 


n one item is 


f that item, Wi 
hose instances, 


Predictions might be made for every case by 
cutting above and below 2.5, in which case 
the index would yield 77.2% accuracy. Cut- 
ting scores might be established below ret 
and above 2.9. In this case, 172 Short Stay 

dicted with 84.3% accu- 


cases would be pre 
and 153 Long Stay cases would be pre- 


dicted with 87.6% accuracy. Thus 71.1% of 
d be predicted with 85.8% accu- 
racy. If homogeneity rather than size of sam- 
ple is emphasized, cutting scores might be 
established below 3.7 and above 1.1. In this 
case, 102 Short Stay cases would be predicted 
with 91.2% accuracy, and 116 Long Sta: 

cases would be predicted with 91.4% bond 
racy. Thus prediction is possible for 47.7% 
of the sample with 91.3% accuracy. The i 
lidity of the index might also be expressed di- 
rectly in terms of the correlation between ii 
dex scores and short and long stay. A biseri 1 
correlation of .759 was obtained. a 


Discussion 


By means of this index, sample; 

À 3 2 S gi 
size and with a given probabili ty s S given 
short stay may be selected from the R A 

nts 
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entering the hospital under study. Generaliza- 
tion of these results to other neuropsychiatric 
hospitals must, of course, await further cross- 
validation studies. It should be pointed out 
that none of the variables in the final form 
of the index are restricted to a veteran popu- 
lation, and that it has potential applicability 
in any neuropsychiatric hospital. 

The value of this index for research lies in 
its usefulness for the economical preselection 
of stratified samples for intensive study dur- 
ing the course of hospitalization, Homogene- 
ous populations of potential long or short 
stay patients may be selected for immediate 
study or for assignment to treatment pro- 
grams for evaluative purposes. 

The index is also seen to have immediate 
service value. In those hospitals where an in- 
tensive continued treatment Program is avail- 
able, those patients who fall in the Long Stay 
group could be transferred to such a program 
immediately upon completion of the routine 
admission procedures, Correspondingly, short- 
term therapeutic and counseling procedures, 
designed to be completed on the Admissions 
Service, could be instituted without delay for 
those patients in the Short Stay group. 

In addition to the usefulness of the index 
for prediction, the variables themselves al- 
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low for certain speculations concerning their 
psychological implications. The finding that 
length of stay for single patients exceeds that 
for others suggests a possible differentiating 
adaptive factor. The other group, which would 
include the married, widowed, separated, and 
divorced persons, have at some time in theif 
lives attracted and formed a relationship with 
another person, and thus may possess greater 
personal resources. An alternative explanation 
is that the single patients are less likely © 
have an established setting in the community 
to which to return, However, this explanation 


fails to account for the fact that separate 
and divorced 


the same probability of 
married and widowed, f 

It should be pointed out that history © 
alcohol was scored in the study wherever ! 
Was mentioned as Contributory to the curre? 
need for hospitalization, as well as where | 
was an established diagnosis, Several possibi? 
explanations can be advanced for the high y 
significant relationship between alcoholis™ 
and “short stay.” In part, it may reflect * 
&roup of patients who ordinarily maintal? 
adequate integration, but whose defenses can 
be temporarily weakened by alcohol, neces! 
tating short-term hospitalization. On the oth? 


short stay as di 
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SCORES (LOGS) 


rt-stay and long-stay cases on the revised index, 


Patients achieved approximately 


00 ————_—————— 


Predicting Stay in NP Hospital 


hand, it 
Current pe the inappropriateness of 
‘urther a. al treatment for the alcoholic. 
at the eee interpretation might be 
ling anxiet of alcohol as a means of han- 
the develo y is generally not associated with 
mptoms, pment of perseverant psychotic 
ws R 
diagnoseg perest that although psychiatric 
'eliability ave been shown to be of doubtful 
tions for hloan, 1952), their implica- 
EMonstrat, ngth of hospital stay have been 
Study, hi ad to be valid predictors in this 
ein in three of the final vari- 
nett compet sis, Degree of incapacity and 
thee’ ine which reflect the diag- 
u 'S Case th nes of psychiatric observers. In 
Ndetlying «4° judgments seem to reflect two 
in, Psyc Se nna severity of illness 
ne Ptopria s and the previously mentioned 
y Ss ness of treatment in the general 
he acter ao hospital for alcoholics an 
€ raised Pana While the argument cou 
ana these initial judgments merely 
atment a the patients’ course of hospital 
„et Dredi short or long), the accuracy © 
simonio, ictive value suggests the more par- 
Benuinel, explanation that the judgments 
Ment oe reflect the patients’ need for treat- 
a neuropsychiatric hospital. 


The Summary 
ental yma value for research in chronic 
edict Iness of an instrument for the early 
ieateg a of length of hospital stay was Im- 
- Data on 21 demographic variables, 
raaro” 
\ gut 
\ ont 
\ pated 
\ gost 
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available within three weeks of hospitaliza- 
tion, were gathered from clinical record fold- 
ers. Five variables were found to predict sig- 
nificantly for the initial and cross-validation 
samples. Based on the combined samples 
(N = 457), an index was devised which pre- 
dicted Short Stay (under 90 days) and Long 
Stay (91 days or more). The validity of the 
index depends on the cutting point selected. 
Prediction can be made for the entire sample 
with 77% accuracy, or for approximately one- 
half the sample with 91% accuracy. Potential 
uses of the index and the psychological im- 
plications of the significant variables were 


discussed. 
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BRIEF REPORTS 


VISUAL AFTERPHENOMENA IN DIAGNOSIS? 
DERWOOD E. JOHNSON, ROBERT W. BAUER, ann DON 


Evansville State Hospital, Evansville, Indiana 


Absence or inadequacy of spiral aftereffects 
has been noted in patients with organic brain 
involvement. There is some evidence to suggest 
that functional psychiatric patients also partially 
fail in reporting apparent motion or phi phe- 
nomena. Stationary afterimages in these groups 
have not been investigated. 

In this research, spiral aftereffect and station- 
ary afterimage responses were noted in normal 
individuals, in patients with organic brain impair- 
ment, and in patients having a functional diag- 
nosis without indication of organic impairment, 
who were capable of responding to Psychological 
examination. An attempt was made to relate re- 
sponse to degree of impairment or extent of 
morbidity by classifying “severe” and “mild” 
groups in both categories. A total of 100 em- 
ployees and patients was used, with subgroups of 
20 subjects. Age differences between groups were 
due to the exclusion of aged persons from the 
normal and functional groups. Since brain syn- 
drome diagnoses are common among older pa- 
tients, these were included in the organic sample. 


Nineteen records (16 of patients diagnosed as 
having chronic brain syndrome) were rejected 
because Tesponses were doubtful, 


1 An extended 
without ch 


or $1.25 for Photocopies. 
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The apparatus for the spiral aftereffect w 
similar to that used in previous research, To tes 
a visual afterimage phenomenon not involving 
apparent motion, the “black and white” atlas 
effect was used. Four cards were presented: 
black card with white center, a white card W! 
black center, and gray cards for afterimages. a 

Group scores were evaluated for differenc® 
and Fisher's ¢ test applied. Postdictive efficien” 
of the two tests was also calculated. he 

Differences within groups in response to ee 
two tests were attributed to chance. Both tes 
yielded significantly different performance reco" ‘i 
when normal subjects were compared with grouP 
of patients, However, neither test discrimina jit 
brain syndrome patients from functional patien 
at a satisfactory level 


tives and false positi 
tests were significan 
severe functional gro; 
port the conclusion 


, and the rate of false negi 
ves was very high. The p 
tly correlated except in 3 
up. Although the results am 
that visual afterphenome do 
are deficient in mental hospital patients, they ae 
not support the hypothesis that observed ith 
ficiencies are associated almost exclusively W? 
organic brain impairment, 
The low postdictive 
seriously disabled 
clinical utility with 
such as are commo; 
examination. 


efficiency obtained in m 
population would imply a 
borderline or equivocal ce 
nly referred for psychologi® 
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INSIGHT AS A MEASURE OF ADJ 
KINDS OF GROU 


USTMENT IN THREE 
P EXPERIENCE* 


JOHN H. MANN 
New York University 


anp CAROLA HONROTH MANN 
College of the City of New York 


The 


r > 
t0 the Present study is one of a series devoted 


ie rison of the relative effectiveness of 
and sion, task-oriented study group 3C- 
en ee role playing in_Pro- 
grou nality and behavior change. hese 
tf methods have been used in a wide 
Petsonaliti Settings as a means of influencing the 
Bote osen, of group members and were there- 
ie gee comparison in this study- 
erous, On, assessing personality change are 
te p ne of the criteria recently used to 
ersonality change is insight. In opera- 
defined as the 
individual's 
thers have 


t 
ucing 
three 8 


Variet: 


tig’ 
ona] 
degree Piras, insight is usually 
vor hin a enee between an 
. Insi n and the view which o 
Pres ght was used as the criterion gr 
ao study. The insight scores were de- 
aract actor analytic studies of the observ- 
studi eristics of individuals in small groups: 
Q es have recently been summarize 
954), who concludes that most of the 
; E small group interaction can be de- 
th 'Vidual Det of the following 
(g Ociabj ‘rominence, Group Goal Fa i 
A of ability. Two variables highly loaded on 
ae factors were selected aS the rating 


wit 

gatho p7tended report of this study may D 
W, Ool of hee from John H. Ma 

a *shingto rts and Science, New 
e T Square, New York 3, 
a! Doc the American Documentation 
™ or $ ‘ument No, 5776, remitting $1.25 

1.25 for photocopies. 
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on which the insight scores were based, 
in order to ensure the broadest coverage of inde- 
pendent content in the rating criteria chosen. 

The study investigated the relative effective- 
ness of the three group methods in improving 
insight of group members. Ninety-six Ss were 
randomly selected from a graduate course and 
assigned to 12 groups (3 discussion, 3 study, and 
6 role playing) of eight members each. Measures 
of insight were obtained near the end and at the 
beginning of each of the group experiences which 
extended over & three-week period. The analysis 
of the data obtained from these measures indi- 
cated that (a) the three types of group experi- 
ences did not differ in the degree to which they 
increased insight of group members; (b) all group 
members showed increase in insight over the 
course of the group experiences; and (c) no 
relationship was found between amount of in- 
sight and individual adjustment. In addition, it 
was found that the role playing Ss revised their 
self estimates in the direction of group estimates 
more often than group estimates were revised in 
the direction of the individual’s self estimate. 


criteria 
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THE EFFECT OF EGO INVOLVEMENT AND SUCCESS 
EXPERIENCE ON INTELLIGENCE TEST RESULTS» 2 


ROBERT C. 


Purdue Universit y 


Most discussions of intelligence testing proce- 
dures emphasize that rapport and ego involvement 
on the part of the S are important aspects of a 
testing situation, and that cues as to success or 
failure on parts of the test should not be given 
by the examiner. A knowledge of the probable 
effects of these variables is important for users 
of intelligence tests, since in the individual test- 
ing situation the examiner must often make al- 
lowance for lack of optimum attitudes on the 
part of the S or decide to what extent the atti- 
tude of the S has invalidated the test results, 

To obtain data relevant to this question, 11 
examiners administered the Wechsler-Bellevue 
Intelligence Scale to eight Ss following a success 
experience, which was produced by showing the 
S false norms after taking a brief figure identifi- 
cation test. The other half of the Ss were simi- 
larly given a failure experience. Half of each 
examiner’s success and failure Ss were given 
special ego-involving instructions which empha- 
sized the importance of the intelligence test they 
were about to take. The other Ss were given in- 
ee 

1The data for t 
graduate students i 
testing at Purdue 
1956-1957. Those 
Irwin Monashkin, 
Paul Carlson, 
Engle, Judith 
McKay, Ray 
Richard Wich, 


2 An extended Teport of this study may be obtained 
without charge from Robert C. Nichols, Department 
of Psychology, Purdue University, Lafayette, Indi- 
ana, or for a fee from the American Documentation 
Institute. Order Document No. 5777, remitting $1.25 
for microfilm or $1.25 for photocopies. 


his study were collected by the 
in the writer’s class in intelligence 
University in the spring semester, 
participating in the study were 
graduate assistant, Karl Beck, 
George Cerbus, Eugene Ebner, Gerald 
Flanigan, Shirley Karas, Harrison 
Mentzer, Deodandus Striimpfer, and 
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structions designed to minimize ego involvement- 
The 88 Ss who volunteered for the study were 
male undergraduate engineering students rangi 
in age from 18 to 32 and ranging in full sca 
IQ from 99 to 140. The mean IQ for the grouP 
was 124, 

Considering success, ego involvement, and €% 
aminer as experimental variables, the data wer 
analyzed according to a 2 X 2X11 analysis ° 
variance design. Separate analyses were done a 
the verbal and Performance scales, and for dig" 
span and information plus comprehension SU 
tests. The results are clearly negative. In the 1 
F tests computed, no significant effects We" 
found. an 

These negative findings support the assumpti” 
that differences in test taking attitude on t 
part of the S and minor differences in testi” 
Procedure on the part of the examiner do 1% 
materially affect intelligence test scores. Hor 
ever, since the Ss used in this study were a 
intelligent students who are used to taking tef 
and doing their best, the results may not 5 
directly applicable to clinic and hospital grouk” 
who may have less motivation to excel on in 
lectual tasks, d 

Since the 11 examiners used in this study }®” 
limited experience with the test, the lack of SE 
nificant differences between examiners is es? 
cially significant. With normal intelligent $S» 
used in this study, individual intelligence uy 
scores are independent of special motivating 3 
distracting aspects of the testing situation ov 
a fairly wide range of conditions. 
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Brief Reports 


The Journal of Consulting Psychology will 
accept Brief Reports of research studies in 
clinical psychology for early publication with- 
out expense to the author. The procedure is 
intended to permit the publication of soundly 
designed studies of specialized interest or lim- 
ited importance which cannot now be ac- 
cepted because of lack of space. Several Pages 
in each issue will be devoted to Brief Reports, 
published in the order of their receipt with- 
out respect to the dates of receipt of the regu- 
lar articles. Most Brief Reports appear in the 


first or second issue to go to press following 
their final acceptance. 


An author who wishes to submit a Brief 
Report: 


1. Sends the Brief Report, limited to one printed 


Page and Prepared according to the specifications 
given below, 


2. Also sends t 
Search study, in 
count of its b 
clusions, 
Document: 
ability, 


o the Editor a full report of the re- 
sufficient detail to give a clear ac- 
ackground, procedure, results, and con- 
which will be filed with the American 
ation Institute to insure indefinite avail- 


3. Prepares at least 100 mimeographed copies of 
the full report, which the author will send without 
ane to all who Tequest it as long as the supply 


4. Agrees not 


g to submit the full 
Journal of gener, 


report to another 
al circulation, 


Specifications 
Brief Report. The Brief Report should give 
a clear, condensed summary of the procedure 
of the study and as full an account of the re- 
sults as space permits. 
To insure that the Brief Report will be no 
longer than one Printed page, its typescript, 


including all matter except the title and the 
author's lines, must not exceed 85 lines av 
eraging 42 characters and spaces in length, 
Set the typewriter margins for short lines 0 
42 characters, which are 3.5 inches long ™ 
elite typing, and 4.2 inches long in pica. 
The manuscript of the Brief Report mus! 
be double spaced throughout. Except for its 
short lines, it follows the standard style 0 
the 1957 revision of the APA Publication 
Manual. Headings, tables, and references are 
avoided or, if essential, must be counted 1” 
the 85 lines. Each Brief Report must be at 
companied by a footnote in the style below: 


which is typed on a Separate sheet and 17 
counted in 


the 85-line quota: ! 


2 An extended Teport of this study may be ie 
tained without charge from John Doe, 300 Mar 
St., Prospect 6, M: 


e 
ass. (giving the author’s full na 
and address), 
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not copy 
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fied by the Publication Manual. 
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ON THE BREAKDOWN OF THE SENSE OF REALITY: 


A STUDY OF SPATIAL PERCEPTION INS 


CHIZOPHRENIA ' 


ANN HOZIER * 
Topeka State Hospital, Kansas 


aa breakdown of the sense of reality in 
an bie es has been viewed clinically 
0 per feature of abnormal behavior. 
li eas is the importance of the loss of re- 
e seve tact in diagnosing mental illness, that 
be tity and the depth of this illness has 
X ae €asured clinically by the severity and 
Freud Veness of this loss of reality contact. 
Arte (1953c, 1953d), when he attempts to 
Fela of is psychoanalytic views to the total 
Suish Mental deviations, chooses to distin- 
this Neurotic from psychotic pehavior by 
5 age factor of reality relationship- 
alit, C518 does not deny the existence of re- 
denies $ merely tries to ignore it; psychosis 
“lse oe and tries to substitute something 
learnt (Freud, 1953c, P: 279). 
the on ly, this loss of reality contact 15 not 
“use WY symptom of mental illness. Yet, be- 
tionin Ìt extends to all aspects of human func- 
Mou 2? it is safe to say that it is of para- 
Scrip; importance in determining and circum- 
the "8 psychotic behavior. In this sense, 
of g (© Search for the causes of 4 breakdown 
Search s ense of reality becomes practically a 
or or the causes of psychotic breakdowns. 
dence years, clinicians have been using evr 
One e of disturbance in spatial perception pe 
ality the manifestations of the los of re 
dudes ntact The psychiatric examination in- 
y €S such questions as «Who are you? and 
a are you?” Confusion with regard to 
Parti his study is part dissertation submitted in 
wi ie fulfillment p 4 quirements for MT ot 


the yt of phil raduate 
Press niversity. alc enhy to tie wishes to ex- 
ing pe atitude to Austin M. Des Lauriers for allow- 
oft a the opportunity of exploring with him some 

2 og iplications of his theoretical ideas. ae 
Congin,” êt Mendota State Hospital, Madison, Wis 


and place is considered 
lity severance. Yet, the 
between confusion about 
disturbance of one’s ori- 
d the breakdown of the 
d, with few excep- 


orientation to person 
an indication of rea 
intimate relationship 
oneself, the loss or 
entation in space, an 
sense of reality has receive 


tions, little exploration. 

Des Lauriers (1955, 1956), in an extensive 
study on the breakdown of the sense of re- 
ality in schizophrenic children, offers a sys- 
tematic set of hypotheses concerning the es- 
sential conditions for the development of 
stable reality relationships. His approach 
touches upon the intrinsic or structural as- 
pects of the breakdown of the sense of re- 
ality. It is less concerned with what, exter- 
nally, might bring about the breakdown 
(family conflicts, organic brain pathology, 
heredity, congenital defects, etc.) than with 
what, internally, it involves. 

The Des Lauriers hypotheses are developed 
ntext of the psychoanalytic theory of 


in the co 

the ego (Federn, 1952; Freud: 1927, 1953a; 
Hartmann, 1957; Hartmann & Lowenstein, 
1948; Rapaport, 1954). Des Lauriers hy- 


pothesizes that the primary model of reality, 
in the psychological experience of the indi- 
vidual, is the awareness of one’s bodily self 
as bounded, finite, separated, and differenti- 
ated from everything that is not the self. The 
establishment of the bodily self is hypothe- 
sized by Des Lauriers to be intimately re- 
lated to the amount of affective cathexis of 
the body. 

The present study was designed to test, in 
part, the validity of Des Lauriers’ theory, by 
investigating experimentally one of its logi- 
cal consequences and extensions. The problem 
which was chosen concerned the perception of 
spatial relationships by the schizophrenic in- 


185 


186 Ann Q. 
dividual, as it is directly related to the prob- 
lem of the bodily self. 

If we assume, as Des Lauriers does, that 
the psychological model of reality is the ex- 
perience of one’s bodily self as differentiated, 
bounded, and separated from everything that 
is not the self, then we may hypothesize that 
the loss of the sense of reality in the schizo- 
phrenic individual involves a breakdown in 
the bodily self as a consequence of insuff- 
cient cathexis of the body. This does not mean 
that the schizophrenic individual does not 
have affective cathexis available to him. He 
does, but he is not using it in cathecting his 
body. As long as the body is not sufficiently 
cathected to become bounded and differenti- 
ated from everything that is not the body, 
there exists no frame of reference from which 
to judge the reality of events in the external 
world or the reality of one’s own psychologi- 
cal experiences, Consequently, as long as the 
self/nonself differentiation does not exist, all 
types of problems involved in the separation 
of self from nonself will be in some way af- 
fected, and among these problems is the prob- 
Jem of spatial relations and organization. 


Methods and Procedures 
Subjects 


_ The Ss were 25 schizophrenic women pa- 
tients at Topeka State Hospital. The control 
group consisted of 25 women, eight of whom 
Were employed by the hospital, two as psy- 
chiatric aides, and six as secretaries. The re- 
maining women were housewives. 

e selection criteria for the schizophrenics 
were: (a) an established psychiatric diagnosis 
of schizophrenia of at least two years’ dura- 
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deficiency; (d) not under treatment with 
insulin coma or electric shock therapy; and 
(e) cooperative as judged by their ward psy- 
chiatrist and the investigator. 

The selection criteria for the controls were: 
(a) at the present time not hospitalized in a 
psychiatric hospital; (4) under the age of 60; 
and (c) no implication of neurological in- 
volvement or mental deficiency. All of the 
control Ss volunteered to participate in the 
experiment. 

The raw score of the Vocabulary subtest of 
the Wechsler-Bellevue, Form I, was used as 
an estimate of intelligence. A comparison of 
the control and schizophrenic groups on the 
variables of age, education, and intelligence is 
Presented in Table 1. The F test for homo- 
geneity of variance with the appropriate t 
test as recommended by Edwards (1950) was 
used to evaluate the difference between the 
means of the groups. None of the means were 
significantly different, 

The duration of illness, which was defined 
as the amount of time elapsed between the 
first diagnosed schizophrenic breakdown and 
the time of the Study, ranged from 2 to 28 
years, with a mean of 10.41 and a standard 
deviation of 4.15. The first schizophrenic 
r population, then, occurred 
on the average in the early thirties, There 
were eight patients each of the paranoid an 
chronic undifferentiated type; four of thé 
catatonic type; and one each of the hebe” 
phrenic, simple, mixed, affective, and acut 
undifferentiated type. The acuteness or chro” 
nicity of their symptomatology varied. Som? 
of the patients needed maximum supervisio™ 


oe others minimum, and a few were in the prot” 
lon; (6) under the age of 60; (c) no evi- ess of obtaining Positions outside of the hos 
ence of neurological involvement or mental pital. 
Table 1 
Comparison of the Control and Schizophrenic Groups on Age, Education, and Intelligence 
— a = = = = SS ———SSS 
ie ` eerarinare a 
R . ri 
7 ducation Raw Vocabulary core 
Group M SD M SD M a 
Control ao 2080, ap | 
i i : F 12.2 4 10.86 
Schizophrenic 43.40 16.45 ie po min 9.27 
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Experimental Materials 


g3 4 Figure Placement task. The Street 
fake-A Pi the Living Room Scene of the 
tuted th icture Story (MAPS) test consti- 
Pictures oe models for the background 
l inches) hese scenes were redrawn (83 X 
mension m pencil so that the horizontal di- 
tance, į Was the main dimension of impor- 
amount T the pictures were centered. The 
and the, „Structure of the scenes was changed 
tial co size distortions corrected. An essen- 
Fig, e y by the Street Scene is presented in 
heoi the Living Room Scene in Fig. 2. 
female — male figures of the MAPS and 
teproduced ure drawn by the investigator were 
inches į at three different sizes, 42, 3, and 
Of the fi in height. An essential reproduction 
gures is shown in Fig. 3. 
Krylon as and figures were sprayed with 
to elimin rystal Clear Spray Coating in order 
the M Apo smearing. The regular stage of 
the slots with a sheet of galvanized iron 1m 
and onio three small magnets, colored pencils, 
g E paper constituted the remain- 
h erials, 
fop -° Poll task. McCall’s pattern No. 2000 
the aie rag doll was the basic model for 
; Ciee rae of the dolls. The pattern was 
nch in and decreased by one-fourth of an 
fer nt order to make three dolls of three dif- 
atms Sizes. The dolls had detachable legs, 
be jain hands, and head. All parts could 
Ich “i z snaps. There were some En 
f the ody part belonged, two on the 8! © 
iat Fag two at the waist, and two IM 
fa a next to the head-body snap: The 
and buttons down the front of the bodies 


Fig. 1, The Street Scene. 


Fig. 2. The Living Room Scene. 


were embroidered. There was a total of 30 
pieces, 10 belonging to each doll. 

The Draw-A-Person task (DAP). A piece 
of plain white paper 8} X 11 inches and a 
No. 2 pencil were the materials for this task. 


Experimental Procedures 
All the Ss were administered all three tasks 
by the same examiner in one setting lasting 
approximately 40-50 minutes. 
The Figure Placement task. The Ss were 
seated immediately in front of the MAPS’ 
stage on which a plain piece of white paper 
laced. After a demonstration on 


had been p 
the use of the magnets to hold the figures on 


Fig. 3. The human figures. 
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the stage, this paper was removed and the 
first scene presented. 

There were three trials for both scenes. On 
the first trial for each, all six figures were 
placed, in random order, on the floor of the 
stage. The Ss were told to place any three of 
the figures on the scene wherever they looked 
most appropriate—wherever they looked best 
to them. Only the two same-sized figures were 
used for the subsequent trials. The Figures A 
(48 in.), B (3 in.), and C (14 in.) were pre- 
sented, in that order, on both Trial 2 and 
Trial 3. 

Each placement was recorded by placing a 
piece of onionskin paper over the scene and 
marking the lower left-hand corner of the fig- 
ure with different colored pencils depending 
on the trial. 

The Doll task. The 30 pieces of the dolls 
were randomly spread out. The head of the 
largest doll, Doll 3, was held by the examiner 
and the following directions given: 


There are a number of pieces here. Some of them 
belong with this and some of them do not. I want 
you to take all the pieces which belong to this and 

ut them together with this. Just snap the Pieces on, 
If you have any difficulty with the snaps, just let me 


know, and I will help you. Let me know when it 
looks all right to you. 


The Draw-A-Person task. The Ss were 
given the following instructions: 
I want you 


to draw a person—, 
the best you Person—a whole person, Do 


can, 


Scoring of the Experimental Tasks 


The Figure Placement task. The Figure 
Placement Was scored by placing the onion- 
skin over 10 squares to the inch graph Paper. 
The Placements were scored to the nearest 
tenth of an inch. The vertical dimension was 


recorded only to check the proper groundi 
of the figures, a, p 


For both 


e judgments as to the 
appropriate placements for 
on each background. The 


possible range of 
each size figure 
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mean of the range of their judgments was 
used as an index of the most appropriate 
placement for each figure on each back- 
ground.® 

The final score for the Figure Placement 
was the absolute sum of the deviations from 
the mean appropriate placement for each size 
figure on each background. There were tw 
other errors which indicated inappropriateness 
of placement. Both referred to the grounding 
of the figures. Grounding refers to placing the 
figures in a stable, upright position with the 
feet standing on a solid surface. Figures which 
are tilted are standing precariously on the 
ground, whereas the completely nongrounded 
figure gives the impression of floating in the 
air. Only those deviations which constituted 


unequivocal tilts or nongroundedness_ were 
scored. 


A A or major errors, What con- 
stituted minor and major errors was decide 


upon a priori; however, some unanticipate! 
, thus necessitating some a 


differentiated 
phrenics, whe: 


; n age, educational level, and 1” 
telligence wer 


€ not controlled. The total sco” 

* The judged mean appropriate placements on th? 
Street Scene Were as follows: Figure A, 1.8 in.; Fig 
ure B, 3.6 in.; and Figure C, 4.6 in. On the Livi”? 
Room Scene, the judged mean appropriate place 
ments were as follows: Figure A, 1.6 in.; Figure *' 


3.1 in.; and Figure C, 4.6 in. A 
+A 1-page scoring manual for the DAP has be“ 
a epi 


osited with the American Documentation Inst 
tute. Order Document No. 5820, remitting $1.25 fo 
microfilm or $1.25 for photocopies. 
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fos the DAP is the sum of the individual scor- 

mg points. 
ae factors considered to be involved in 
form Perception are position, direction, size, 
fake and distance (Warren, 1934). The 
Sere general, reflect varying degrees of 
wre in terms of spatial demands. The 
vidual i the least demanding. Here, the indi- 
Paper, ned only by the limits of the 
any Wa € may define the human figure in 
structure he likes. The Doll presents more 
uman = Tt demands that the Ss organize the 
forms pong in relation to the head which 
(Cohn 15 central theme of the body image 
form th 53). In the DAP, he can create the 
Parts: ie size, and the relation of the body 
mang, © the Doll, he must follow the de- 
the „> Placed on him by the presentation of 
form a of a certain size in order for the 
r bck and placement of the parts to ap- 
Leet appropriate. In the Figure 
tureq » the problem is much more struc- 
* the human form is created for the S 


and 
Ship i Must place it in appropriate relation- 
Both o fairly well-structured backgrounds. 


eflect i Doll and the DAP are presumed to 
“ehtig Primarily the problem of spatial per- 
body n and organization in relation to the 
lem p 24d Figure Placement, the spatial prob- 
€aling with the external world. 


A Hypotheses and Results 
hige Median test with a chi square test of sig- 
ae (corrected for continuity) Was ae 
Roy, Uate all the differences between it 
to SA A one-tailed test was used throughou 
ed the level of significance.” Ss 
Shiz tet variability on all tasks fort 
the phrenic group is predicted because ; 
they aring degrees of reality severance i 
Yatying cally manifest and consequently ee 
Cention degrees of disturbance of spatia P 
Th n which is expected. : 
y Figure Placement Task if 
frames tee the schizophrenic has nO intrinsic 
ims ie Teference and because he experienci 
elf as boundless and fluid, other objects 


a both Bees table giving the frequency 
tl y ee On all three tasks has bee! 
Scument merican Documentation Institute. 
°F $1.25 fo. or 5820, remitting $1.25 for me 

°F Photocopies, 


distributions 
n deposited 
e. Order 
rofilm 
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assume this fluid, nonstable quality. When he 
is asked to place a well-organized human fig- 
ure in appropriate relationship to a fairly 
well-structured background, that figure is not 
experienced by him as having definite form, 
bounds, and limits as it is experienced by 
nonpsychotic Ss. Consequently, having neither 
the well-delimited bounds of his own body 
as a reference nor being able to utilize the 
bounds and limits of the external world de- 
fined for him, it is predicted that the schizo- 
phrenic Ss place the figures significantly more 
deviant from the judged mean appropriate 
placement than the control Ss. 

Table 2 shows that the schizophrenics did 
place the figures significantly more deviant 
from the judged mean appropriate placement 
than the controls, with the exception of the 
placement of Figure A on the Living Room 
Scene. The F tests indicate that the schizo- 
phrenics were significantly more variable in 
their placement of the human figure on fairly 
well-structured backgrounds than the control 
group on the task as a whole, on placing Fig- 
ure C on the Street Scene, and in placing all 
figures on the Living Room Scene. 

“2. Furthermore, since the schizophrenic is 
not differentiated from the world, i.e., cannot 
maintain adequate distance between himself 
and external objects, it is predicted that he 
place the figures more to the foreground than 
the controls, i.e, in the direction of fusing 
with them. This prediction was supported by 
the following data. 

The distance between the average actual 
placement of Figure A and Figure C on both 
scenes was less for the schizophrenics than 
for the controls. On the Street Scene, the dis- 
tance between the actual placement of Figure 
A and Figure C for the controls was 3.03 in., 
and for the schizophrenics, 2.09 in. On the 
Living Room Scene, the distance for the con- 
trols was 3.39 in., and for the schizophrenics, 
2.79 in. That is, the schizophrenics tended 
to cluster the figures more than the control 
group. That this clustering of the figures was 
toward the foreground was witnessed in the 
less distance between the placement of Fig- 
ure C and the foreground (0.00) for the 
schizophrenics than for the controls. On the 
Street Scene, the average distance between 
the placement of Figure C and the foreground 
was 4.80 in. for the controls, and 3.94 in. for 
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Table 2 
Comparison of the Control and Schizophrenic Groups on the Figure Placement Task in Terms of the 
Deviation from the Mean Appropriate Placement 
Control Schizophrenic 
(N = 25) (N = 25) 
Grand 
Scene Fig. M SD M SD I P Mdn. X£ R 
A 1.02 1.60 1.96 1.35 1.41 = 1.54 5.36 025 
Street B 1.04 1.66 2.08 2.21 1.77 — 1.00 3.62 05 
E 0.88 1.29 1.86 3.46 7.32 .01 0.88 2.82 05 
A 1.18 1.16 1.86 1.65 2.02 05 38 0.76 25, 
Living Room B 1.04 1.18 3.40 2.80 5.64 01 140 17.12 005 
c 1.24 1.86 3.51 5.39 8.40 01 1.83 5.88 ol 
Combined | 
Placements 6.45 4.20 15.05 12.06 8.29 .01 6.00 7.86 009 


the schizophrenics. On the Living Room Scene, 
the average distance was 4.69 in. for the con- 
trols, and 3.84 in. for the schizophrenic group. 
3. Since the schizophrenic does not experi- 
ence his body as having weight and solidity 
and, therefore, in need of a solid surface on 
which to stand, it is predicted that the schizo- 
phrenic Ss evidence significantly more non- 
Sroundedness than the control Ss. The rela- 
tive infrequency of the two types of non- 
Sroundedness led to the decision to tabulate 
them together. Six of the controls and 11 of 
the schizophrenics gave one or more non- 
grounded responses, which is not statistically 
Significant (x? = 1.426, p = .15). 
The Doll Task 


Body parts are not experienced as integral 
parts of the body by schizophrenic Ss, The 
form, size, and the position of body parts are 
distorted. These difficulties arise because of 
the breakdown of the bodily self, of the ex- 
perience of its size, its unity, and its ex- 
tensions. Nonpsychotics, whose bodies are 
well-bounded, do not show such disturbances 
in spatial perception. Thus, it is predicted 
that the schizophrenics receive a significantly 
higher error score and that they omit signifi- 
cantly more body parts, show more size dis- 
tortions, and more misplacements of integral 
parts of the body than the control Ss. 

The schizophrenics did receive a signifi- 
cantly higher error score (x? = 23.16, P= 


.005), and were significantly more variable 
than the controls (F = 5.94, p = 01), Table 3 
shows the number of Ss in each group giv” 
ing one or more “pathological” responses 0" 
omissions, size, symmetry, reversals, and mls 
placements. The incidence of asymmetry wa 
rare, whereas reversals, although they °~ 
curred, occurred with nearly equal frequen“! 
in the two groups. The minor misplaceme? 
of placing the arm on top of the shoulde 
rather than to the end of the shoulder, 0° 
curred infrequently, but with approximately 
equal occurrence in the two groups, The ©” 
squares for the incidence of omissions of int® 
gral parts of the body, for size distortions ° 
both a minor and major variety, and mis” 
placements of a major type, indicated that 
the schizophrenics did make significantly mor 
errors and gave significantly more “patholos” 
cal” responses than the control Ss. 


The Draw-A-Person Task 


i 

It is predicted that schizophrenics shor 
the disorganization and distortion of thé! 
bodily self and, consequently, the breakdow” 
of spatial perception, as reflected in the draw 
ings of the human figure, by the omission °° 
body parts and joints, by the lack of prop?" 
tion between the body parts, by transpa” 
encies, and by the lack of essential detaili”? 
which would indicate the human qualities u 
the figure significantly more than the contr? 
Ss. These errors, in general, reflect the schi2 
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Phrenic’s disturbance in the experiencing of 
his body size, of his solidness and unity as a 
uman form, and of his extensions. 
Schizophrenics did score significantly lower 
a 8.052, Ż = .005), and were significantly 
contr Hagel (F = 2.08, p= .05) than the 
the ols. Table 4 shows the comparison of 
in and schizophrenic groups on the 
Widual items of the DAP. Of the 24 items, 
differentiated between the groups at the 
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.05 level of significance or better. The pres- 
ence or not of eyebrows, eyelashes, mouth, 
hands, arms, feet, and number of fingers did 
not differentiate between the groups. All of 
the items referring to proportion and flexi- 
bility of the body did differentiate signifi- 
cantly between the groups. Schizophrenics 
showed significantly more transparencies with 
reference to clothing, i.e., if clothing were 
present, the body could be seen through it. 


Table 3 
a Comparison of the Control and Schizophrenic Ss on the Doll Task 
Number of Ss 
a a 
Schizo- 
Control phrenic 2 ignifi 
Items Ww 25) (N = 25) ai Seia 
Omissions 
1. Hands (3 ec)" 
2. Feet (3 ec) 13 any i 
3. Body (6) i 
4. Arms (3 ec) 
5. Legs (3 ec) 
Size 0 4.25 025 
6. One size deviant (1 ec) Ks 14 ae i 
- Two sizes deviant (3 ec) 
Symmetry 
s Head not centered (3) 0 2 7 E 
9. Arms not symmetrical (3) 
10. Legs not symmetrical (3) 
Reversals 
11. Arms reversed (1 ec) 13 14 7 
E Legs reversed (1 ec) 
3. Body reversed (3) 
Misplacementsb 5 5 7 a 
14 2 
+ Arm-shoulder (1 ec) 
2 Arm-head (3 ec) 
i Arm-waist (3 ec) 
ie Arm-thigh (3 ec) 
8. Leg-waist (3 ec) 8 ji a 


19. Leg-chest (3 ec) 1 
-eg-shoulder (3 ec) 

Leg-head (3 ec) 

Leg-neck (3 ec) 

Hand-leg (3 ec) 

Hand-head (3 ec) 

— 


1 Weight tin 
e The fire Scores for each item used in calculatins second. 
named body part is connected with t 


~ + Foot-arm (3 ec) ae 


g total error score. 
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Table 4 


Comparison of the Control and Schizophrenic Ss on the Individual Items of the DAP 


Number of Ss 


Schizo- 
Control phrenic E 
Tema (N = 25) (N = 25) x Significance 
Presence of 
1. Hair 25 17 7.29 005 
2. Hair-circumference 18 6 9.70 .005 
3. Forehead 25 20 3.56 05 
4. Eyebrow 19 14 1.43 a5: 
5. Eyelashes 6 4 man = 
6. Chin 25 17 7.29 005 
7. Mouth 25 22 m = 
8. Neck 22 17 1.86 10 
9. Shoulders 21 11 7.03 005 
10. Hands 8. 6 ya pen; 
11. Arms 25 22 ai — 
12. Number of fingers 9 8 = = 
13. Feet 23 18 2.17 10 
14. Clothing 24 10 15.53 .005 
Proportion 
15. Head 21 13 4.50 025 
16. Arms 21 9 10.08 005 
17, Legs 22 10 10.50 005 
Flexibility 
18. Shoulder or elbow joint 24 9 17.47 005 
19. Hip or knee joint 22 8 14.08 005 
20. Arm attachment 23 15 5.37 025 
21. Leg attachment 25 19 4.74 025 
Transparencies 
22. Clothing 20 6 13.54 .005 
23. Outline of head 10 5 1.52 15 
one 6 3 = 


* Each item contributes one point to the total score. 


There was no significant difference between 


the 8roups in showing transparencies in ref- 
erence to the head, i.e., seeing the outline of 
the head through the hair. 


Discussion 


The over-all results of this investigation 


lend support to the Des Lauriers hypotheses 
on the conditions which are necessary for the 
development of a sense of reality. The signifi- 
cance of the difference between the control 
and schizophrenic groups in terms of errors 
on both the Doll and the DAP was taken to 
indicate that the schizophrenics do have a 


significant problem in the perception of and 
organization of the body in relation to spari 
Despite the extreme and predicted variabilit 

of the schizophrenic group, the difficulties 5 
spatial perception were sufficiently paramou b 
not to be cancelled out by this variability” 
The results of both the Doll and the DAP i 
dicated that the schizophrenics distort ane 
misplace body parts, and omit essential pa" 

of the body. ith 
That the schizophrenics as compared W ri 
the controls failed to indicate that the a 
and legs of the human figure were capable on 
Moving, i.e., that they were attached app” 
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a on had well-defined joints, is of par- 
an E suggesting, as we are led to 
Ego ps i our knowledge of psychoanalytic 
eller, ology and our knowledge of the de- 
is of j ent of the bodily self, that movement 
from eee for differentiating the body 
import e world. Freud (1953b) stresses the 
Ween ance of movement in differentiating be- 
ody mnl] which come from within the 
SER i stimuli which come from without. 
import, y (1953) feels that actions are of such 
not m ance in differentiating the me from the 
Posi that he states that if action were not 
e ees the body and the world would 
Postulat y line with Des Lauriers’ theoretical 
renic: es, it is hypothesized that in schizo- 
ion ae there is a breakdown of the delinea- 
Schizo pe body from the world. That the 
Cant Pirenics did not clearly and signifi- 
Mi Y indicate the potentialities for move 
Postitate En as support for this theoretical 
ps schizophrenic is obviously capable of 
imself ae but he tends not to experience 
tiatoy as the one moving—as the prime ini- 
Seque of his actions, Nor does he see the con” 
thay OSes Of his action on another and realize 
a is he who is doing thus and S0. T h 
forts Veness of Des Lauriers’ therapeutic : 
fog os schizophrenic children in which | he 
uta S Considerable attention 1 polnting 
child e effect of movement on his part 0P 4 
the 28 well as the effect of movement on 
Child’s part on him, adds support to suc 
“nderstanding, ? 
indicateqn® of the Figure 
renie the inappropriateness © 
©S spatial perception and 


of + 
tem Problem which he exper! 


Placement clearly 
the schizo- 


the severity 
ences in at- 


Ween ns to relate his body to the ee 
ten ic (1957) has stated that the schiz 
ants. tend to overestimate distance 

dis Testimate the size of objects seen al 
With ge The results of this invest ich 
the parti i materials W. 
vs particular stimulus SE E 
Me], K 
dist, 9? that the schizophrenics un 
See tee and overestimate the size of objects 


en at n i 
Wi a distance. This finding Ù |1 
nn the prediction that the schizophrenics 


ten, 
Unable fuse with the world, i.e., that they are 
e to maintain sufficient distance between 
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themselves and the world. With different 
stimulus materials and assuming with Ek- 
stein and Wright (1952) some capacity for 
“defensive maneuvers” it may be that Wec- 
kowicz’s results would be confirmed. We did 
not assume, in this investigation, that the 
schizophrenic had such a capacity for “defen- 
sive maneuvers,” since it would imply that 
he, in the first place, was capable of ap- 
preciating distance, and only as a second 
thought, so to speak, removed himself to the 
background. 

That the breakdown of the sense of reality 
involves a breakdown of the bodily self was 
witnessed by the omissions of integral parts 
of the body, by the disproportionate size of 
the body, by the misplacements and failure 
to maintain proper spatial relations between 
parts of the body, and by the inability of the 
schizophrenic Ss to place the body in appro- 
priate spatial relationship to the world. That 
this breakdown of the bodily self is a conse- 
quence of insufficient cathexis of the body is 
assumed supported by the nature of the logi- 
cal deductive reasoning used in this experi- 
ment. If there were no loss of cathexis, there 
would be no breakdown of the bodily self; if 
there were no breakdown of the bodily self, 
there would be no disturbance in spatial rela- 
tions and organization. 

Certainly, the tasks are related to spatial 
relations and organization. What part other 
variables may play in accounting for the sig- 
nificant results cannot be determined by the 
present study; however, the results cannot be 
accounted for on the basis of age, sex, edu- 
r intelligence since the groups were 


cation, 0 i 
equated on these variables. Shakow (1946) 
has suggested that many of the significant 


findings which differentiate between schizo- 
phrenic and control Ss are attributable to the 
lack of cooperation and interest of the schizo- 
phrenics rather than to the particular variable 
or variables which the experimenter is investi- 
gating. We do not think this to be true in our 
present research. Only those schizophrenic Ss 
who were judged by their ward psychiatrist 
to be cooperative and who did willingly co- 
operate in this investigation were used. All 
the control Ss volunteered and thus their co- 


operation was assured. We assume, then, that 
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it is not a lack of cooperation which is deter- 
minant for our significant results. 

Since it was necessary to make modifica- 
tions in the Doll scoring system on the basis 
of the data, its sensitivity in significantly dif- 
ferentiating a control from a schizophrenic 
group must be cross-validated. 


Summary 


The purpose of this study was to explore 
one of the implications of Des Lauriers’ theo- 
retical postulates regarding the conditions 
necessary for the development of a stable 
sense of reality. 

Twenty-five hospitalized schizophrenic 
women and 25 nonhospitalized women were 
administered three tasks, Figure Placement, 
the Doll, and the DAP, all of which involved 
active dealing with spatial relations and or- 
ganization. Disturbances in dealing with the 
Doll and DAP were presumed to reflect pri- 
marily the spatial problem of dealing with 
the body, and Figure Placement, the spatial 
problem of dealing with the relationship of 
the body to the world. 

As predicted, the schizophrenic group made 
significantly more errors and was significantly 
more variable on the over-all tasks than the 
controls. The prediction also was made that 
the schizophrenics would make significantly 
more errors and be significantly more variable 
than the control group on the component 
spatial factors involved in each task, such as 
size, position, form, and distance. For the 
most part, when there were frequent enough 
occurrences of the items, the results were sig- 
nificant and in the direction predicted. 

The results of this investigation add to the 
validation of the Des Lauriers? hypotheses. 
Significant disturbances in spatial Perception 
in reference to the body, and in reference to 
the body and the world were found. This 
breakdown in spatial relations and organiza- 
tion is interpreted as an indication of the 
breakdown of the bodily self. The breakdown 
of the bodily self is interpreted to be a con- 
sequence of a diminution of Narcissistic ca- 
thexis of the body. 


Received May 14, 1958. 
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Maier 43 previous articles (Maier, 1956; 
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then frustrated behavior not only makes prob- 
lem solving incidental to the needed goal ob- 
ject, but may actually be in conflict with it. 
Thus it lacks goal-orientation and therefore 
represents a class of behavior without a goal. 
Such behavior is determined largely by condi- 
tions inside the organism, so that the expres- 
sion of emotions and feelings, rather than 
what they achieve, characteristically accom- 
pany behavior selected under conditions of 
frustration. The environmental condition of 
availability rather than need-satisfying prop- 
erty appears to become dominant during frus- 
tration. If behavior instigated by frustration 
is adaptive, at times, this is due to natural 
selection rather than to the organism’s ability 
to solve a problem. Thus an angry person 
may strike a man who blocks his path and 
the man may collapse. However, if the cause 
of the blow is anger rather than the removal 
of the obstacle, the success is incidental to 
the purpose. 

Behavior expressed under conditions of frus- 
tration is characterized by some combination 
of aggression, regression, and fixation (com- 
pulsion) ; in contrast to behavior expressed 
under conditions of motivation which is char- 
acterized by variability, constructiveness (ma- 
turity), and the exercise of freedom of choice. 
A problem situation or obstacle in the path, 
therefore, may either motivate an organism 
to show problem-solving behavior or frustrate 
him to show destructive, rigid, or immature 
behavior. The outlook in one instance is 
«what to do,” in the other it is blaming, hos- 
tility, or self pity. Which of these types of 
behavior is expressed depends upon the con- 
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dition of the organism, since the same objec- 
tive problem may cause both types of behav- 
ior to appear in a group of individuals. 

The definitions of problem situations and 
of frustrating conditions are basically alike; 
the difference is in the behavior observed. 
This does not mean that some situations may 
not be more likely to frustrate people than 
others; rather, a crucial condition—an ob- 
stacle in the path of a goal—is a common 
characteristic of both. A determining differ- 
ence in such situations is the amount of pres- 
sure or force exerted in requiring that the 
obstacle be circumvented. This pressure may 
serve either to motivate or to frustrate, and 
therefore produce opposite effects. 

Although some individuals are more prone 
to show frustrated behavior than others, or- 
ganisms are alike in that each possesses two 
qualitatively different behavior possibilities. 
This means that operational definitions of 
frustration and problem situations are essen- 
tially incomplete since the organism in ques- 
tion determines what effect obstacles and 
Pressure will have on it. It follows, therefore, 
that even though situations may differ in de- 
gree, the organism’s behavior will differ in 
kind. 

The three concepts that characterize frus- 
tration theory, and therefore serve as critical 
areas for testing it, are (a) the assumption of 
a frustration threshold; (b) the postulation 
of a qualitative distinction between behaviors 
instigated by frustration and by motivation; 
and (c) the adoption of the principle of avail- 
ability to account for the selection of re- 
sponses that are expressed during frustration 
(as contrasted with the function of needs or 
excitatory values in motivated behavior). 

These three Concepts were developed in or- 
der to account for research findings obtained 
from the study of rats in a specific type of 
conflict situation. If they serve to interpret 
human behavior under stress, as well as ani- 
mal behavior in widely different situations 
there will be reason for assuming that these 
assumptions are fundamental principles. 

Although Psychoanalytic theory and frus- 
tration theory may make some of the same 
predictions, it is clear that the reasons sup- 
plied and the principles used will be different 
in origin and in kind. It is recognized, there- 
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fore that in some instances two or more theo- 
ries may make similar predictions and will 
have to be evaluated by additional criteria. 
With respect to the appearance of qualitative 
distinctions, psychoanalytic theory and frus- 
tration theory have some common features 
and some differences. For example, frustration 
theory may predict a bimodal distribution 
of results, while psychoanalytic theory may 
assume qualitative differences (discontinuous 
distributions) because the concept of levels oF 
steps is inherent in the theory. For example, 
a child’s relations with his mother may show 
qualitative changes as he moves from one 
psychosexual Stage to another. However, the 
concept of levels does not limit the findings 
to bimodal distributions in behavior data, and 
this difference can lead to critical tests. At” 
other difference js that frustration theory pre 
dicts behavior differences due to two physio- 
logical mechanisms, whereas psychoanalyti¢ 
theory stresses cultura] (learned) factors 4 
nces. Finally, psychoana 
make one cautious in aP” 


sion-making. 
It is not our attem, 
one theory has more uni 


riety of data and 
analysis of data 


theory that is tested it is hoped that oth 
researchers will see fit to test their findings ? 
relation to frustration theory. At the prese” 
time the failure to test for bimodal distrib’ 
tions in data makes it impossible in many 3” 
stances to evaluate frustration theory, a” 
this oversight may lead to the loss of critic? 
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at coping with the threat of Nazism by get- 
ting out of Germany. Clearly here, the stress 
of Nazism caused behaviors in some Jews that 
might be considered maladjustive (resignation, 
regression, displaced aggression) and in others, 
behaviors which can be classified as construc- 
tive. The authors point out that the simple 
frustration-aggression hypothesis of the Yale 
group (Dollard, Doob, Miller, Mowrer, & 
Sears, 1939) is quite inadequate to account 
for the wide range of behaviors exhibited un- 
der stress. The variations in behavior mani- 
fested and the possibility of grouping certain 
behaviors as constructive and others as non- 
constructive or destructive points to the need 
for the postulation of a threshold principle to 
account for apparently contradictory results. 

The research of Barker, Dembo, and Lewin 
(1941) dealing with the effects of frustration 
on play behavior also reveals opposite reac- 
tions to interferences with need satisfaction. 
Out of 30 children, 5 showed an increase in 
constructiveness, whereas 25 showed a de- 
crease in the constructiveness of the play be- 
havior when the barrier was lowered separat- 
ing the child from the highly valued toys. All 
of the 5 children showing an increase in con- 
structiveness were in the group defined as the 
weak frustration group (those which showed 
relatively little time in performing frustration- 
instigated behavior, such as aggression against 
the barriers, etc.). Again, it is apparent from 
these data that introducing stress into a situa- 
tion does not cause the same kind of behavior 
in all members of a group. 

Other data show that the postulation of dif- 
ferences in frustration thresholds clarifies the 
appearance of splits in a population when 
stress is introduced. Block and Martin (1955) 
in a partial replication of the Barker, Dembo, 
Lewin experiment attempted to account for 
the observed differences in play behavior by 
relating them to some other personality vari- 
able defined as “ego-control.” Ego-control was 
measured in terms of the ability of a child to 
delay gratification (collect candy without eat- 
ing it), co-satiation (continue working on a 
task on which they had been saturated), and 
finally, on observed ratings of ego-control. 
The specific predictions made were that the 
overcontrolling child will exhibit less decre- 
ment in constructiveness in play between pre- 
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frustration and frustration situations than the 
undercontrolling child. Hence, a negative cor- 
relation should exist between change in play 
constructiveness and either delay of gratifica- 
tion scores, or co-satiation scores. The results 
obtained were in the predicted direction and 
statistically significant. 

It would appear from the consideration of 
these studies that some sort of threshold con- 
cept is of value in the analysis of data from 
studies concerned with the effects of stress 
and/or frustration. In addition, the Block- 
Martin data suggest some of the parameters 
that may be related to a frustration threshold. 
The fact that individual reactions to stress 
frequently are of an opposite nature indicates 
the difficulty of reporting results in terms of 
group trends. Merely reporting the average 
decrease in constructiveness of play as a func- 
tion of frustration hides the fact that indi- 
viduals reacted to the stress in different ways. 
The inconsistent findings on the motivating 
value of stress likewise point up the need for 
analysis of individual differences. 

The postulation of a frustration threshold 
also may serve to explain why the Yale re- 
searchers (Dollard et al., 1939) were unable 
to obtain a correlation between the degree of 
aggravation introduced and the amount of ag- 
gression expressed. The concept of a threshold 
makes a change in behavior an all-or-nothing 
phenomenon, such as Maier and Feldman 
(1948) obtained when they varied the length 
of time rats Were exposed to the insoluble 
problem situation, 

Recently, Shimoyama (1957) repeated this 
study but varied the degree of frustration in 
the insoluble problem by using four fre- 
quencies of punishment (0%, 30%, 50%, 
and 70%) supplied randomly. He found that 
the number of rats with fixations increased 
with the punishment ratio, the Percentages 
being 0, 18, 30, and 60. No differences in the 


the rigid behavior. Shimoyama followed the 
$ l alter- 
nated with trial and error for breaking fixa- 
tions thus making it possible 


to measure these 
strengths. 
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The Qualitative Distinction 


The assumption of a threshold concept to 
account for the changes in behavior that oc- 
cur during frustration implies that the process 
underlying behavior expressed during frustra- 
tion is qualitatively different from the process 
underlying problem-solving or goal-oriented 
behavior, since different behavior mechanisms 
would be put into operation. Thus in frustra- 
tion theory it is assumed that frustration- 
instigated behaviors differ from goal-oriented 
behaviors in terms of the way in which they 
are related to the stimulus and behavior se- 
quences. If two behavior mechanisms exist: 
behavior data should be clearly divisible int? 
two types. The classifications goal-oriented 
and frustration-instigated reflect the way 
Maier (1949) originally divided behavior in 
a problem situation, Accordingly, goal-ori- 
ented behavior was de 


an end (goal) 
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eed system developed 
Ullman (1958) to account for the appear 
ance of “compulsive” eating behavior in rats: 
and the one developed by Mowrer and viek 
(1948) to account for eating inhibitions in 4” 
escape situation. Failure to entertain the po% 
sibility of a basic dualism at the outset force 
them to assume even greater complexities a? 
diversity later on in order to reconcile incon” 
sistencies and to correct for theoretical dis” 
crepancies. The above illustrations taken fro™ 
the experimental literature are reminiscent 0 
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tion procedure, and for 10 of the animals a 
punishment extinction procedure alone was 
used for 10 days before the combined extinc- 
tion procedure was instituted. When the data 
are analyzed in terms of this procedural 
breakdown, it was found that all 6 of the ani- 
mals which received the glass barrier pro- 
cedure prior to the combined extinction pro- 
cedure extinguished their avoidance responses, 
whereas only 8 out of 10 of the animals which 
received the punishment procedure extin- 
guished. Furthermore, the mean number of 
punishment shocks in the combined extinc- 
tion procedure reflected the influence of 
whether the prior extinction procedure was 
the glass barrier or the punishment. That is, 
the six dogs that had the glass barrier prior 
to the combined procedure required only 8.2 
shocks in the combined procedure, while the 
animals that had the punishment procedure 
ired an average of 14.3 shocks, a differ- 
ence which is significant at the 01 level. The 
important facts of this investigation that re- 
quire explanation are (a) the failure of ordi- 
nary extinction procedures (omission of the 
UCS) to cause extinction, (b) the differences 
in extinction between animals receiving the 
glass barrier treatment and animals receiving 
a punishment extinction procedure prior to 
the combined procedure, and, finally, (c) the 
failure of extinction in some cases even un- 
der the best of the extinction procedures. 
Solomon and Wynne’s principle of the con- 
servation of anxiety seems adequate to ac- 
count for the first fact—the failure of extinc- 
tion to occur when merely the UCS is omitted. 
In other words, the short-latency avoidance 
reactions prevent the CS from arousing anx- 
jety reactions, thereby conserving conditioned 
anxiety reactions from extinction. Also it can 
handle instances in which extinction occurs 
when only the glass barrier extinction pro- 
cedure is used. However, the principle does 
not account for the fact that some ani- 
mals never extinguish even under the best of 
extinction procedures. This fact of the bimo- 
dality—the split in the population—is di- 
rectly explained by frustration theory be- 
cause it postulates the existence of a frustra- 
tion threshold. Thus animals that become 
frustrated by the UCS will never extinguish 
in the usual way, whereas those with thresh- 
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olds sufficiently high to resist the frustrating 
effects of the UCS will be able to extinguish 
under certain experimental conditions. Fur- 
thermore, the difference in the proportion of 
animals extinguishing among those exposed 
to the glass barrier procedure and those ex- 
posed to the punishment procedure prior to 
the combined procedure also can be readily 
explained in terms of the dual effects of 
punishment postulated by frustration theory. 
Thus, the animals exposed to the punishment 
procedure prior to the combined procedure 
received more punishment for the avoidance 
response than did animals exposed to the prior 
glass barrier procedure. According to frustra- 
tion theory, this additional punishment served 
to make the former group rigid (i.e., resistant 
to extinction), because a greater number of 
the animals had their frustration threshold 
exceeded. The increased resistance manifested 
itself both in the number of shocks required 
in the combined procedure and in the smaller 
number of animals extinguishing. 

Frustration theory does not require that all 
rigid behavior have its basis in frustration. 
Rather, this condition is but one of several 
under which the behavior of an organism may 
exhibit persistence, Other conditions are over- 
learning, the operation of special needs, per- 
ceptual differences, and low intelligence. Thus, 
the failure of extinction in avoidance behav- 
lor may either reflect the operation of a 
frustrated condition, and thus be an instance 
of abnormal fixation, or simply result from 
the lack of a perception of more adaptive al- 
ternatives, due to the nature of the particular 
experimental situation. A learning-motivation 
Concept, such as the conservation of anxiety, 
teadily accounts for the latter alternative but 
is inadequate to account for the first. 

The dual operation of noxious stimuli 
(either as a negative incentive or as a frus- 
trating agent) should also be reflected in 
other types of learning experiments that uti- 
lize them as training aids. If Parameters such 
as intensity of noxious stimulus or the num- 
ber of reinforced repetitions are used, learn- 
ing and motivation principles would predict 
a whole spectrurn of response strengths when 
a random population is tested. However, frus- 
tration theory would predict a bimodal dis- 
tribution of response strengths; fixated and 
nonfixated. For example, if shock were used 
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as a driving stimulus, it would be predicted 
that the percentages of animals falling into 
the fixated group within a given level of shock 
intensity would increase as the shock inten- 
sity increased, but the strength of the fixa- 
tion would not change. If such an experiment 
yielded several groupings of response strengths 
that were a function of the intensity of the 
Noxious stimulus, a case could be made against 
the necessity for postulating a frustration 
threshold and the qualitative difference Þe 
tween fixated behavior and ordinary habits. 

The part played by needs in determining 
response strength might be tested by using 
different kinds of noxious stimuli, If the 1° 
sults yielded as many groupings of extinctio” 
Scores as types of noxious stimuli used, the? 
a strong case would be made for the vie 
point that response strength is a function 0 
the type of motivation used and that differ 
ences in types of motivation can cause splits 
In a population, F Tustration theory, however 
would demand bimodal distributions with! 
each type of noxious stimulus. 

A study by Hammes (1956) may be used 
to illustrate the dual effects of noxious stim” 
lation when used as a training device. In 2 
experiment utilizing two levels of task dif” 


culty and three levels of shock motivatio™: 


rats had to learn to escape from cba 
a shock 
through the one of tw 


o doors that had thé 
Correct card on it, Performance was measur? 
in terms of two criteria: (a) the number ° 
trials to learn and (b) the number of erro 
made. In the easy task (black-white discti™™ 
nation) three intensities of shock motivati? 
(low, medium, and high) caused only 9” 
failure to learn (i.e., reach a 10 successiv” 
errorless trial criterion) in each conditio” 
However, in the difficult task (discriminati? 
between two circles with a 4-1 size diffe” 
ence) the number of animals failing to re? 
the criterion of learning increased from 6 J 
10, as the shock intensity increased. Of yi 
terest from the point of view of frustratio” 
theory is the fact that (a) bimodal distrib?” 
tions were obtained with each of the diffe" 
ent levels of motivation used, and (b) h 
number of animals falling into the failu” 
&roup increased as the level of shock vA 
raised. Hammes, however, treated his data ” 2 
terms of group averages, and as a result thes 
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relationships, which must be maintained de- 
spite unacceptable behavior. 

Observations of cases of problem readers 
likewise support this approach. It is well 
known that therapy helps some problem read- 
ers more than drill in reading, whereas for 
other children the reverse is true. Research is 
needed to test and evaluate these observa- 
tions. If frustration theory is to serve as a 
guide it follows that mentally retarded chil- 
dren need motivation and drill; whereas frus- 
trated children need therapy to get rid of 
their frustrations, including the resultant re- 


gression. 


The Principle of Availability 


Frustration theory postulates that when an 
organism is in a state of frustration, the 
mechanism for selecting or determining be- 
havior differs from the one that operates dur- 
ing conditions of motivation. The theory 
states that the specific character of the re- 
sponse elicited will be determined by its de- 
gree of availability to the subject, and that 
the response will have the property of ag- 
gression, regression, fixation-rigidity, or some 
combination of these. 

Although the mechanisms for response se- 
lection under conditions of motivation vary 
somewhat with the point of view of the 
theorist, the factors usually mentioned include 
excitatory value of stimulus, the needs of the 
individual, the previous training of the indi- 
and certain perceptual factors. Al- 
lability may be implied in some 
of these instances it is not usually regarded as 
a determining influence largely imposed by 
the environment. Rather, response selection 
under motivation is consistent with the psy- 
chology of choice behavior, which in turn 
gives the organism a determining role in its 
own behavior. Behavior elicited during frus- 
tration, in contrast, takes on a character of 
compulsiveness SO that the organism may be- 
have in a manner that is inconsistent with its 
choice. 

Factors which make one response more 
available than another require further investi- 
gations to clarify the limitations. However, 
enough is known to include conditions such 
as physical nearness, biological ease (includ- 
ing the response in progress), natural or un- 
learned preferences, primitiveness or simplicity 


vidual, | 
though aval 
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of response, previous experience or training, 
and cultural or sociological influences. 

Although these factors are basically differ- 
ent, they have one thing in common: they 
make certain responses more accessible to the 
organism than others. However, the fact that 
there is a multitude of determinants makes 
complete prediction difficult. One can test 
them only by equalizing the other determi- 
nants while testing one. Whether it will even- 
tually be possible to assign weightings to the 
factors so as to increase prediction remains a 
question. It is likely that individual differ- 
ences will exist and that the weightings will 
fail to generalize completely. 


Physical Nearness 


According to this principle, things or per- 
sons near to the frustrated individual will 
tend to be involved in the behavior to a 
greater degree than other objects. Thus a 
frustrated person is likely to vent his hostili- 
ties on a person physically close to him. Like- 
wise the frustrated person is inclined to use 
objects that are handiest for attack, rather 
than most efficient, For example, a woman 
may throw a plate while drying dishes but 
will strike out with a broom while sweeping. 
S This factor is consistent with the observa- 
tion that a frustrated individual often attacks 
innocent bystanders, which is a puzzle from 
the view-point of problem-solving. It also ex- 
plains Why the source of frustration some- 
times IS attacked since, in many instances, 
the object of frustration is near to the per- 
son who is frustrated. Banging on locked doors 
during fires or while imprisoned, even to the 


i i y, is not uncommon. 
Specific experiments testing this factor have 


there is a good deal 


group (Dollard et al., 
subjects by their drawi 


{ ngs vented their frus- 
tration on the experi 


1 menters. The reported 
negative correlation between the price of cot- 


ton and the number of negroes lynched in the 
South is also in line with this factor, 
Vandalism and thefts of useless objects 
which are difficult to explain on a problem. 
solving or motivational basis, may readily 
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lend themselves to explanation in terms of 
this factor. 


Biological Ease and the Response in Progress 


Other things being equal, the response se- 
lected under frustration is likely to be one 
that is convenient for the individual because 
of his make-up or particular environmental 
Circumstances at the time of frustration. Push- 
ing is easier than pulling, and kicking is 
easier under some conditions than others. 
Thus the form of aggression may vary with 
individuals and with circumstances. Response 
fixation may also be influenced by ease of 
convenience. A forward movement is easiet 
than a turn, and continuation of a respons? 
is easier than a change. For this reason, the 
response in progress at the time of frustra- 
tion tends to be highly accessible, unless the 


conditions of frustration block it in some 
way. 


electric shock 
was found tha 
but that othe 
sponse becam 
response (the 
response to th 


was the initial response, it W4 
oned. This experiment nicely 
demonstrates how the physical arrangeme” 
of a situation and the response in progre® 
makes certain behaviors psychologically mor? 
accessible to the subjects. 

Another example is the “compulsive” eat 
ing symptom described by Ullman (1951): 
His experiment illustrates the fixation of 7 
on-going response, and one need not postulat? 
the highly complex motivational scheme SU 
as Ullman develops in order to account fe 
its occurrence. The literature on perseveratio” 
(Everall, 1935; Hamilton, 1916; Hamilton Fe 
Krechevsky, 1933) and on rigidity is rich ¥ 
data Supporting the principle that the m 
Sponse in progress at the time of frustratio 
is highly susceptible to fixation. 


Integrative Value of Frustration Theory 


Unlearned Preferences 


Personal or species preferences, even when 
ee ned, constitute another factor related to 
= polity, Animals may have preferences 
a Tess; color, position, etc, when pre- 
may b with discrimination choices, and it 
int e assumed that such preferences will 

uence the response selected during frus- 
tration, 
im experiment by Aebli (1952) supports 
actor. Using a large cross maze, un- 
ag Preferences for left- or right-hand 
aid is Were determined in 11 rats. With the 
of a differential delay (60 sec. vs. 5 sec); 
Dost al, were trained in the direction op- 
tae ee initial preference, while 5 were 
erence in the direction of their initial pref- 
tered | After this training, shock was adminis- 
Tals at the choice point. Five of the six ani- 
initia) ne on the opposite side of their 
Dref, Preference regressed to their initia 
aeo ie whereas four out of the fve 
Eren Sh accordance with their initial pref- 
Ce persisted in that response. When a re- 
tning attempt was made with the animals 
regressed to their initial preference it 
found that these animals were fixate 
'd not relearn a response that was 0P- 
their natural preference. This ex- 
t suggests that prior preterea n 
act as strong determiners of be an 
er stress conditions and tend to m^ 


Certaj rs. 
tain ehaviors more accessible than othe. 


Simas 

"plicity of Response 
fixate Ple response is more likely 
Dley ? Other things being equal, th experi- 
H involved one. In the Michigan sistent 
fra (Maier, 1949), it was the a onses 

bree that rats fixated position ie Ac- 
torg; ten than discrimination respons act of 
a ing to this factor it follows that aP SOF 
Stession is more likely to pee esi. 
a nitive type of movement than @ eile 
re : Corollary to this hypothesis it sold 
a Cted that complex activities neat sim- 
Dle © Susceptible to stress variables t this in- 
E Activities: and they should reflet differ- 
i ased Susceptibility both in terms x more 
tapid de tates of acquisition and iP * 

7 ith grioration under stress. he m 
On the ; his frame of reference, the cqui- 

© influence of drive level on the acd 


to become 
an a com- 


aterial 
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sition of simple and complex activities can be 
considered in a different manner, and some of 
the contradictions in the data can be resolved. 
It will be recalled that Taylor (1951) had 
postulated that anxious Ss operate at a higher 
drive level than nonanxious Ss, and since re- 
sponse strength is a multiplicative function of 
habit strength and drive, high anxious Ss 
should learn more rapidly than low anxious 
Ss. This was confirmed for a simple task, such 
as a conditioned eyelid response. However, 
Montague (1953) showed that anxiety actu- 
ally interfered with verbal learning (a more 
complex task). As a result of this finding 
Taylor and Spence (1952) modified the ear- 
lier theory in order to take into account the 
complexity of the task and postulated that 
higher drive states increase the number of 
competing responses that will interfere with 
the correct response in a complex problem. 
More recently though, Saltz and Hoehn (1957) 
demonstrated that when materials in which 
there are competing and noncompeting re- 
sponse tendencies are equated for difficulty, 
the Taylor-Spence prediction was not sub- 
stantiated. Rather, the data pointed to the 
likelihood that task difficulty rather than the 
operation of competing response tendencies 
was the more important variable. This find- 
ing of Saltz and Hoehn is entirely in accord 
with the expectations of frustration theory 
that make a complex or difficult task more 
susceptible to the influence of stress than a 
simple task. Thus, there is no necessity for 
5 ing complex response interference 
processes, such as Taylor and Spence (1952) 
had done, to account for the differential ef- 
fects of anxiety (if one treats anxiety as 
a stress variable) on simple and complex 
learning. : i 

Finally, the previously cited paper by 
Hammes (1956) also may provide evidence 
for this point of view. On the easy task, vary- 
ing shock intensity causes no significant dif- 
ferences on the acquisition of the response, 
whereas on the difficult task high shock re- 
quired significantly more trials for learning, 
and significantly more errors occurred than 
for the low shock conditions. 


postulat 


Training 
Kleemeier (1942) found that a frustrated 
rat will fixate a previously learned alley in 
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preference to a new one if other things are 
equal. However, this tendency is not as strong 
as is usually supposed, and is off-set by the 
greater importance of the response in prog- 
ress and the ease of movement. Nevertheless, 
it must be included as a factor making for 
response availability during frustration. Ac- 
cording to this principle, a trained boxer is 
more likely to hit with a skilled jab than 
with a haymaker when engaged in a barroom 
brawl, while a wrestler in the same situation 
would be more inclined to select a haymaker. 

This factor perhaps would not be crucial 
for testing frustration theory because learn- 
ing is regarded as an important selector of 
behavior in most theories. Frustration theory 
makes learning a less important factor, how- 
ever, and in this respect it might become an 
issue for a critical experiment. 


Sociological and Cultural Influences 


Although cultural influences are learned, 
the effect of culture is somewhat more com- 
plex than that of learning. One important 
complication is that social pressure operates 
to train and to motivate a social individual 
to follow the behavior pattern of his group. 
Although research in this important area is 
sketchy and inconclusive it should be ex- 
plored because of its potential theoretical im- 
portance, 

According to this factor various cultural 
sroups should express their frustrations differ- 
ently. When frustration occurs, males should 
be more likely to show aggression than fe- 
males in certain cultures but not in others— 
depending upon the special values of the cul- 
ture. It also follows that the Proportion of 
physical fighting to verbal attacks in play- 
grounds should vary in different social groups, 
being greatest in groups where a given form 
of aggression is most acceptable. The objects 
selected for attack as well as the mode of at- 
tack likewise will be influenced by cultural 
factors. Thus scapegoats for attack may be 
Negroes, Mexicans, Japanese, Irish, Jews, etc. 
depending on locality or cultural group in 
which the frustration occurs. This cultural in- 
fluence would supplement the factor of near- 
ness, 

The research of Miller and Swanson (in 
press) supplies many illustrations of the man- 
ner in which middle- and working-class groups 
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respond to stress. Because of the cultural dif- 
ferences between these two classes they rea- 
soned that working-class males should be 
more inclined to express themselves by US” 
ing their skeletal muscles, while middle-class 
males should be more inclined to utilize con- 
ceptual modes. Elton McNeil, a member of 
the project, obtained experimental verification 
for this hypothesis, using matched groups ° 
boys from each of the two classes as subjects: 
In a series of experiments reported in th 
volume many class differences were obtained, 
the behaviors tested ranging from levels ° 
aspiration to expressions of aggression. ‘ 
One of the differences, which was primarily 
a function of class rather than child-rearing 
practices, was found when aggression am 
conscience were in conflict, Middle-class boy* 
develop defenses that affect the control 0 
aggression if made anxious about aggressive 
tendencies. These defenses take the form ° 
reversal of feeling, turning on the self, ba 
distortions regarding the attraction of fn 
bidden acts. Working-class boys, however; a 
not inclined to develop defenses against a 
gression and seem less concerned with Ít 
control. a 
When no anxiety against aggression is s 
troduced into the situation, working-class bO. i 
express their anger in the form of physical 4” 
tack, whereas middle-class boys tend to & 
gage in verbal argument or some form of oon 
ceptual aggression. In this instance, ch! 5 
rearing practices are relevant, Working-cla>" 
mothers use corporal punishment to det 
their sons from fighting, who in turn use ae 
advocate direct aggression. They learn the op 
posite of what their training is intended ‘| 
accomplish. Middle-class mothers use psy€ 1 
logical discipline, and their sons in turn ri 
low and advocate a similar pattern of dis 
pline. of 
Miller and Swanson regard the pattern °? 
home discipline to be one of the distingu" 
ing features between these two classes, & i 
they believe that learning plays a predor 
nant influence in determining the obta 
differences. However, it can also be conclu n 
that this early training establishes values We 
attitudes which, in turn, may inhibit the €% 
Pression of certain behavioral modes and “the 
sequently make others more available to i 
child. Tt is clear that these early learnings 4 


eS E 


Integrative Value oj Frustration Theory 


Not speci: A 
ae an that the child is taught to be- 
attitudes gene manner; rather he acquires 
ese se] values from his background and 
e Mill the behavior. 
Menta) ae Swarison studies include experi- 
0 servati based on projective tests as well 
pment of om data. For the further devel- 
Stable to rustration theory it would be de- 
tions [A eee expressions of true frustra- 
Cologi those revealed in test situations. 
th iene class, and cultural differences in 
Patholo lence of various kinds of behavior 
tura] ee also may be explained by this cul- 
that yaactor. Rennie and Stole (1956) find 
ch as Ous kinds of psychosomatic disorders, 
nditions oma, hay fever, arthritis, heart 
derab] high blood pressure, etc., differ 
s i9econo a their distribution along 3 
ae arthritis status range. Thus, hyperten 
Valence wit neuralgia-sciatica increase 
ic st with progressively lower socioeco- 
ba atus, whereas colitis, hives-rash, and 


ever į r ; 
‘acioecon, increase in prevalence with higher 
actors MIC status. Apparently there are 
Jevels that 


Medisnos different socioeconomic 

f Matic se individuals to particular psycho- 
bya is symptoms. That this predisposing 
Y the f not a motivational one is suggeste 

act that no relation between tension- 


Xlet: A 
th end socioeconomic level was obtained. 
ha nilar vein, Odegaard (1956) reports 
predispose 


À Various ki A 
v inds of occupations 7 
Th oe to particular Ern: pathologie®. 
draw eae conclusion therefore may S 
motio, at the symptomatology displayed by 
X pally disturbed peoples varies with 
N » Sex, and socioeconomic status: 


ey B 

a ody Structure, and Personality / 
Uso nlifferences and variations in body build 
abili y be expected to influence e 
Unhappy responses. It is well known 
Xpress 7: home life causes boys 2” 
Par of Meit frustrations differently- ; 
h ese differences may be due 
this i cultural influences, it is best to KER 
X ea Eory separate from others until Jr 
"oping, 0S are found to Þe fully ove 
tor E relevant experiment related to this fac- 
Men pat of Marquart (1948). She observed 
Rte. t0 be more likely to show hostility (@8- 


egg 
Si E : 
on) in her frustration experiments than 
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women, while women were more inclined to 


cry (regression) than men. 
The influence of body structure could best 


be investigated by researchers with different 
animal forms. It will readily be conceded that 
cats, deer, rats, chickens, pigs, etc. respond 
differently to punishment, capture, and at- 
tack, but no comparative studies have been 
made to formulate principles. It also may be 
supposed that a man’s size, strength, and 
physical handicaps will influence his behavior 
during frustration, even after his training and 
culture influences have been discounted. 

The suggestion by Jenkins (1955) con- 
cerning the influence of the kind of muscula- 
ture and degree of physical vigor on the na- 
ture of maladaptive delinquent behavior is 
relevant here. In those children who have 
good musculature and a high level of physi- 
cal vigor; directed aggressive attacks may be 
the child’s way of contacting the world. In 
those weaker and less well equipped for such 
behavior, 2 “screaming loss of control” with 
a hostile resentful overdependence may result. 
In this instance the prognosis 1S towards psy- 
chotic disorganization, whereas in the aggres- 
sive type the end result is usually the aggres- 


sive psychopath. bed j 
Although culture and training overlap with 


conceptions of personality, it should be listed 
as a separate factor. Personality may deter- 
r the first symptom of frustra- 


mine whethe I 
tion will be aggression Or regression. Mar- 
quart’s (1948) study indicated that extro- 


verts were inclined to show aggression, whereas 
socially dependent individuals were inclined 
to show regression when frustrated. More re- 
search is needed to clarify this factor. 


Summary 


The present paper has dealt with the three 
major explanatory concepts of frustration 
theory: the frustration threshold, the qualita- 
tive distinction between frustration-instigated 
behavior and motivated behavior, and the 
principle of availability. Illustrative data from 
the literature of various research areas were 
analyzed from the point of view of the theory 
to demonstrate how its concepts could be uti- 
lized in explaining and integrating these di- 
verse kinds of data. In addition, an attempt 
was made to determine whether these con- 
cepts could clarify research areas that were 
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confused by contradictory data. This was 
done by attempting to integrate the contra- 
dictory data within the framework of the 
theory and also by suggesting questions that 
might be subject to empirical verification. 
The factors that determine the form of ex- 
Pression that frustration will take and the 
types of behavior pathology that may appear 
were examined. It is clear that the nature of 
the provoking conditions, the types of needs 
that are denied, and the intensity of need 
deprivation are insufficient variables to ac- 
count for the findings. Research in this area 
is badly needed and it is hoped that the issues 
raised will suggest additional Problems to ex- 
plore and new categories of data to tabulate. 
Although the present elaboration of the con- 
cepts of frustration theory led to an explana- 
tion and integration of material from a va- 
riety of sources, there is no intent to convey 
the impression that frustration theory is a 
completed system, Many details and relations 
need to be extended and clarified. Since one 
of the requirements of a meaningful behavior 
theory is that it be helpful in generating test- 
able hypotheses and concepts, it is hoped that 
in pointing up crucial issues in a wide range 
of data, differences in theoretical positions 
can be subjected to experimental investigation 
and hence to a further elaboration of the the- 
ory. A Prematurely closed theory may be a 
handicap to new research because it delimits 


the regions explored. What is needed is the 
location of new areas. 
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The 

test grt reported here was des 
Variables į related hypotheses concerni 
3 ne ee the performance 0 

e See children. 

Were inte tticular performance in 
i Ney pA may be described 
i as Mane a child’s intellectua 
t £ Xtent Sured by the Merrill-Palmer. 
“in deye] to which he has accomplished cer- 
Sii opmental tasks which contribute to 


which we 
as the dis- 
] abil- 
and 


Ñ asured ene from home and parents, as 
inet: Reh, y the Vineland Social Maturity 
the vq habilitation workers are interested 
hie Mlables which influence the extent to 
Pa tradicapped children make maximal 
a eir resources. The Meriill- Fae 

ea 


and g; 
a giscrepancy (MP-V) seems to 
Ce relati measure of this ability-perfor™ 
Onshi 
5 Be i p. 
webs fo sets of variables whose relation- 
P-V were studied were: a) ma- 


nal į 

ini 

the dependence training attitudes ane 
in such atti- 


€a $ 
ades oh cw, (b) selectivity " 
fi c) m e basis of the hearing 
Ç €Clel] others’ achievement needs. 
41983 and, Atkinson, Clark, añ 
k (19: presented evidence from "" 
TA eh see demonstrating that achieve- 
‘Penden ivation in boys is related tọ the in- 
ae: Tt a ce training attitudes 0 i 
attitudes ne reasonable that S 
aun ance might also be related tO 
g Ption A handicapped children, 
ten child at MP-V reflects, to s0 
Sn enas 7 s drive to achieve, a5 WÊ 
ty terbott to become independen 
"een ind om studied the relat 
€pendence training attitudes 


tom 


on the as- 
me extent, 
Į] as their 
x Although 


jonship be- 
and ” 


joys, adequate evidence 
this relationship does 
not exist. While mean level of independence 
training attitudes may differ on the basis of 
the sex of the child, and MP-V may also show 
sex differences (although Doll did not find 
them in his standardization of the Vineland), 
there is no reason to suppose that the relation- 
ship between the variables should differ as a 
function of sex, particularly if independence 
training attitudes represent an antecedent 
condition for the behavior being investigated. 
Therefore the present research uses deaf chil- 
dren regardless 

A major problem in Winterbottom’s study 
is the retrospective nature of the mothers’ re- 
he independence training question- 
naire. One might well argue that, rather than 
early independence training being a causative 
element in the production of » Achievement, 
the situation might be reversed. That is, the 
mothers of high 7 Achievers may have re- 
sponded to the questionnaire by reference to 
the ages at which their children accomplished 
the developmental tasks which constitute the 
items. It may be that high 2 Achievement 
children spontaneously “demanded” independ- 
ence early, and in this way influenced the 
mothers’ retrospective age estimates. The re- 
search reported here tends to minimize this 
problem through the use of children who aie 
too young to have accomplished most of the 
developmental tasks listed in the question- 
naire. Mothers’ responses are therefore less 
influenced by past experience with their chil- 
dren. To the extent that this is so, a purer 
measure of attitude is obtained. i 
The second hypothesis studied here was the 


Achievement only in b 
for sex differences in 


of sex. 


sponses tot 
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210 Jesse E. 
favoring later independence, when the groups 
are matched in terms of number of male and 
female children (Table 2, Line 1). However, 
a plot of the data very clearly indicates a 
curvilinear relationship between these two 
variables. All 19 mothers were ranked on 
their independence training attitudes toward 
normal children with Rank 1 assigned to the 
mother with the earliest mean age on the in- 
dependence training questionnaire, and then 
on Achievement, with Rank 1 assigned to 
the mother with the lowest score. When the 
ranks on the two variables are compared, it 
is found that among the mothers ranked from 
6 to 15 on independence training are found 
all but one who ranked below 10 on n 
Achievement. There is no appropriate sta- 
tistic to describe this relationship where the 
N is so small. However, the data do suggest 
that mothers with low achievement motiva- 
tion tend to be more moderate in their in- 
dependence training attitudes toward normal 
children than mothers with high achievement 
needs, 

When the mothers are grouped into early 
and late independence training attitude groups 
on the basis of their attitudes toward deaf 
children, and these groups are equated for 
number of male and female children, it is 


Table 2 


Relationships Between Mothers’ 2 Achievement and 
Independence Training Attitudes 


n Achievement Scores of 
Mothers Categorized as 
High and Low in Inde- 


pendence Traini $ 
Mothers raining Attitudes 


Categorized on: 


High Low {Ratio p 


1. Independence training 
attitudes toward 


normal child 22a 267 87 >.05 


2. Independence training 
attitudes toward 


deaf child 5.89 —122 289 <.05 


3. Discrepancies between 
attitudes toward deaf 


and normal children 3.66 33 110 >05 


" Italicized figures are derived from ana 
groups; nonitalicized figures are derived fr 
not so matched, 


lyses of sex-matched 
om analyses of groups 
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found that the » Achievement scores of the 
mothers favoring late independence are sig- 
nificantly higher than those of mothers fa- 
voring early independence (Table 2, Line 2). 
The mothers were grouped according to the 
size of the discrepancies between their inde- 
pendence training attitudes toward deaf and 
toward normal children and the groups 
equated for number of male and female chil 
dren in each. No significant differences in ” 
Achievement scores were found between the 
mothers so grouped (Table 2, Line 3). 


Discussion 


Our results do not support the hypothesis 
that independence training attitudes towa" 
deaf children are associated with the extent 
to which the social development of deaf ch!” 
dren approaches the limits of their abilitY: 
However, independence training attitudes toj 
ward normal children were found to be a35” 
ciated with this variable. It may be that the 
measurement of attitudes under a “norm? 
child” set provides a more valid estimate ° 
independence training attitudes than doe 
testing under a “deaf child” set, in that es 
responses of the mothers in the former situ?” 
tion are relatively uncontaminated by par 
ticular attitudes toward hearing handicap* 
Our data suggest that in some indirect m2” 
ner these attitudes toward normal childré? 


affect the behavior of the deaf children. It a 
to be noted that the direction of the relatio” 
ship between children’s behavior and the 3” 
dependence training attitudes is opposite 
what was expected on the basis of Winter 
bottom’s findings, A Possible explanation ra 
this may be that as a mother expects mor 
and more from her norma] hearing child, 
deaf child stands in greater contrast t0 te 
normal sibling. Such contrast might opens 
on the deaf child by robbing him of the xsi 
centive to accomplish the developmental tas ae 
which compose the Vineland, through frust ie 
tion and the inability to compete with 
sibling. Thus discrepancies between the 5i 
child’s performance and his ability devel 
An alternative explanation may be that r 
mother who encourages early independent? f 
her hearing child is free to devote more pe 
her interest and nurturance motives to t 
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handi; r 
tal TH ped cma. The increased interest may 
tend to eae of solicitousness, which would 
for the deat ca opportunity and/or need 
pendence child to develop the kind of in- 
Rehabilit measured by the Vineland. 
View that ation workers sometimes take the 
ternal attitud improvement in significant ma- 
thüs l: es toward the handicapped child, 
ehavior, į imately improvement in the child’s 
Cidlina sere upon a reduction of 
andicap o responses to the child and his 
and, that z data Suggest, on the other 
kaia the more important influences on 
Attitudes ee child are not the maternal 
Ward chil oward the handicap but, rather, to- 
The c îldren in general. 
ent morn ineat relationship between achieve- 
training lation in mothers and independence 
N inter attitudes toward normal children is 
thay ae one. The relationship indicates 
ighly motivated mothers expect inde- 


Deng, 

e A 

R “4 either very early or very late. This 
May j gest that achievement motivation 


nt i ape . 
€ract with response dispositions as in 
ponse 


Hul 
Stre ren tive theory to intensify res 
at the. a thus, high drive mothers are foun 

bine es of the distribution in inde- 
Children. training attitudes toward normal 


0 

Motja Vers this kind of relationship between 
Spons and response is not found where the 
Here ie is directed toward deaf children. 
“late, Chievement motivation is clearly ass0- 
ty n With the failure to encourage early m- 
ta fy It may be that the occurrence 
Mater a dicap in the family operates tO focus 
t Ac al achievement needs, such that high 
x as ement mothers perceive the handi- 
Ponse „& challenge. The overprotective re- 
tne atp plied in the late independence trai 
Ma titudes of high n Achievement mothers 
Riy 7 of such a nature that reduction of the 
torci, meet the challenge occurs, thus re- 
W Pe Protective attitudes. The increasing 
ra i i of a deaf child, on the other 
p ther “a be perceived as a threat tO a 
a Be which, views the handicap a5 @ chal- 
aS ent of she must meet. Thus the enton 

E ld no Fany independence in 4 deaf chi 
Sn such © reinforced, Perhaps it is for rea 
as these that with reference to im 
training attitudes toward 2 deaf 


211 


child, high achievement motivation operates 
unidirectionally, rather than simply by in- 
tensifying early training or late training re- 
sponse dispositions, as was the case with atti- 
tudes toward normal children. 

To summarize, the over-all picture suggests 
that high » Achievement mothers tend to 
overprotect their deaf child, or to wish to, 
but they may go to either extreme with their 
normal children. If they go to the extreme of 
favoring relatively early independence in nor- 
al children, the result may be a tendency 
d to develop independence 
han his capacities would 


m 
for the deaf chil 
at a slower pace t 
suggest. 

Summary 


This research was designed to test three 
hypotheses concerning the behavior of hear- 
ing handicapped children: (a) The extent to 
which a deaf child’s social maturity level ap- 
proaches the limits of his ability is related to 
the independence training attitudes of the 
child’s mother; (b) The extent to which so- 
cial maturity levels of deaf children approach 
their ability levels is related to the extent to 
which mothers’ independence training atti- 
tudes toward deaf children differ from their 
attitudes toward normal children; and (c) 
Maternal independence training attitudes are 
associated with mothers’ achievement motiva- 
tion. 
Ss were 19 mothers and their deaf preschool 
children. Six TAT cards were administered to 
‘ollowing McClelland’s standard 
instructions, and their stories scored for n 
Achievement according to McClelland’s cri- 
teria. Mothers were also administered part of 
Winterbottom’s Independence Training Ques- 
tionnaire, once with the set to respond with 
reference to their deaf children, and once with 
a set to respond with reference to their nor- 
mal hearing children. 

Social maturity relative to intellectual abil- 
ity was measured in the deaf children by the 
discrepancy between Merrill-Palmer and Vine- 
Jand Social Maturity Scale scores. 

The major results were as follows: 

1. Attitudes favoring early independence in 
normal children were found in the mothers of 

who showed relatively large 


deaf children e 
Merrill-Palmer discrepancies. 


the mothers, f 
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2. Independence training attitudes toward 
deaf children, and discrepancies between atti- 
tudes toward deaf and normal children were 
not associated with Merrill-Palmer—Vineland 
discrepancies. 

3. Mothers with low achievement needs 
tended to be moderate in their independence 
training attitudes toward normal children, 
while high 7 Achievement mothers tended to- 
ward the extreme positions of favoring very 
early or very late independence. 


Jesse E. 


Gordon 


4. High » Achievement mothers favored 
significantly later independence in deaf chil- 
dren than did low » Achievement mothers: 
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P ; 
Mith Polosists have long been concerned 
„ Vatlous aspects of the ability of people 
8e others (Taft, 1955). Studies based 
" Co-worker, or buddy ratings, i.e., rat- 
up he individual by other members of his 

» dave been summarized, in part, by 
r (1954a). The method rests on the 
on that peers, by virtue of their close 
iGo with one another, have oppor- 

ea Pag aie a global fund of information 
e Ch other and that this information 

Sampled by appropriate means. 

Studied the reliability and validity 
and methodology (1956) of peer rat- 
herry and Fryer (1949) found that 
Y ratings were reliable and identified 
es 2 Potential among army officer can- 
S Much earlier than did tactical officers 
Ore accurately than did academic 10- 
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come well enough acquainted with each other 
before they could make valid inferences about 
future performance. Peer ratings made dur- 
ing orientation week predicted instructors’ 
final (16th week) military aptitude grades. 
Willemin and Rosenberg (1957) observed 
that mental ability was not related to the abil- 
ity to judge fellow soldiers among advanced 
infantry trainees. 

In a study on morale, Webb and Hollander 
(1956) found peer ratings superior to both 
self-evaluations and to a survey technique. 
Willemin, Rosenberg, and White (1957) 
found that buddy ratings predicted the six 
areas (group loyalty, dependability, knowl- 
e of the combat task, performance under 
stress, aggressiveness, and initiative) of the 
Combat Aptitude Scale better than did pre- 
dictions based on personality, reasoning, per- 
ceptual speed, perception under distracting 
conditions, psychomotor, and Army Classifi- 
cation tests. 

Thus, peer ratings have formed the basis 
for valid predictions regarding estimates of in- 
telligence (Webb, 1955), morale (Webb et al., 
1956), leadership (Wherry et al., 1949), suc- 
cess in aviation cadet training (Hollander: 
1954a, 1954b, 1956a), performance in medi- 
cal school (Kelly, 1957), and army combat 
effectiveness (Willemin, Birnbaum, & Rosen- 


berg, 1957). 
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Peer ratings have not been applied to the 
many problems of prediction and evaluation 
as related to mental patients. This study 
adapts the method of peer ratings to the 
study of prognosis in such patients. The pur- 
pose of this study was to investigate whether 
a group of open ward psychiatric patients 
from a VA general medical and surgical hos- 
pital could predict, by means of peer ratings, 
their own and each other’s adjustment in 
four specific areas during the two-year pe- 
riod following their discharge from the hos- 
pital. The treatment staff also rated these 
patients by following the identical procedure 
which the patients used. 


Method and Results 


Predictions of the prospect of rehospitali- 
zation, and the post-hospital work, family, 
and health adjustment of all patients on the 
ward were made once each month for six 
months by every patient and staff member. 
Each S was individually interviewed and 
asked to check Yes, No, or Cannot Say after 
each patient’s name for each of the following 
predictor questions. Each patient also rated 
himself. 


1. Do you believe that this man will have to be 
hospita ized again for a neuropsychiatric condition 
within a period of two years following discharge? 

2. Do you believe that this man will work steadily 
for the next two years after he leaves the hospital? 

3. Do you believe that this man will have serious 


family trouble within the two- i vi 
PEE year period following 
k Do you believe that this man will enjoy good 
pl sical and mental health for the two years fol- 
lowing discharge from the hospital? 


The staff of 21 included: a s 
trist; five psychiatric residents: 
aides and nurses; y 
therapists, recreati 


taff psychia- 


were neurotic, 20% 
psychophysiologic reactions, and 15% were 
character disorders. 
31.5 years. Although patients were discharged 
from the hospital at 
patient was included 
veys, on the average. 

After two years, follow-up data were col- 
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lected on all 36 patients. Of the 26 patients 
still residing in the state, 24 were studied at 
the hospital by a staff interviewer and a staff 
observer. One patient was seen by a prison 
psychiatrist and psychologist, who forwarded 
the necessary data, and the other was visited 
at his home by a Red Cross field worker. 
Complete data on the remaining 10 patients 
were obtained through the cooperation of the 
Red Cross, the VA, and the Army, and 
through correspondence with the patients or 
their relatives. 

The post-hospital data were studied in 
terms of the following criteria. Each criterion 
was dichotomized, paralleling the form of the 
predictor questions. 

Rehospitalization. Any inpatient hospitali- 
zation on any psychiatric ward during the 
two-year post-hospital period. 

Work adjustment. A work index was de- 
vised to evaluate a patient’s vocational ad- 
justment: 


time employed , duration of longest job 
since discharge ™ held since discharge 


total time since discharge 


Work index = 


The work index value was doubled if the pa- 
tient was employed and working at the time 
of the follow-up examination. The arbitrary 
weights of the variables comprising this work 
index yielded values which ranged from 0.0 
to 4.0. A value of 3.0 or greater was set 
in advance as the criterion for satisfactory 
work adjustment. For example, a patient was 
judged to be making a satisfactory work ad- 
justment if he was currently employed and 
had held one job at least 75% or more of the 
time since hospital discharge, or a patient 
who had held two jobs consecutively and had 
worked at them full time without any period 
of unemployment, etc. Two judges, using 
their own standards, dichotomized the post- 
hospital work history data independently and 
agreed with the categorization derived from 
the work index in 30 of 36 cases (83.3%). 
The work index was used as the sole criterion 
of work adjustment in computing correlations 
which appear later in this study. 

Family adjustment. In order to meet the 
criterion of satisfactory family adjustment, 
the patient had to have a history free of the 
following since leaving the hospital: deser- 
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tion, long separation, divorce, prolonged ex- 
tramarital affairs, rejection of an acceptable 
family home, or acting out behavior (alcohol- 
ism, criminal or sexual assault) directly at- 
tributable to family conflict. Using this defi- 
nition, two independent raters agreed on 30 
a 36 cases (83.3%). The remaining differ- 
nces of opinion were discussed and recon- 
ciled by the raters. 

Health adjustment. A patient was defined 
as having good general health if any symp- 
tom (s) that he had manifested was not suffi- 
ciently disabling so as to seriously interfere 
with his over-all functioning as a citizen. Two 
independent judges agreed on 32 of 36 cases 
(88.9%). The four cases on which opinions 
differed were discussed and the differences 
Were reconciled by the raters. 
a preliminary questions were asked of 
the data. What was the reliability of the rat- 
ings of the patient-peer group, and of the staff 
group? How closely did the patients asteg 
With the staff in making their predictions? 
Each patient was given a Yes or No desig- 
nation each month as long as he remained in 
the study on each of the four prediction ques- 
tions. For example, a Yes for a patient dur- 
ing a particular month on the first question 
Meant that the majority of the rating group 
(peers or staff) were of the opinion that 
Month that this patient would be rehospital- 
ized on a psychiatric ward within two years 
following his discharge from the hospital, ees 

he average of all the biserial correlation co 
efficients between adjacent pairs of monthly 
group ratings over the six months’ study pi 
riod was .60 for the patient-pee"s and .77 for 
the staff. Both of these correlations Were sig- 
nificant at the .01 level, and the difference 

etween them was also significant eit, a 
level. It is not too surprising that the stali 
ratings were more reliable than the patients 
Yatings in view of the high rate of taok g 
among the patients and the absent® of per 
sonnel turnover among the staff. Biserial cor- 
relation coefficients computed each month for 


six months between the patients’ distributions 
and the staffs distributions ranged berween 
01 level. 


-57 to .82, all significant at the 

A tabulation of the criteria S 
About one third or 13 of the 36 pa 
made an excellent adjustment in ê 


owed that 
tients had 
11 four 
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areas. About two thirds or 23 patients were 
making a satisfactory work adjustment, but 
two thirds had serious family trouble. One 
third or 12 patients had failed to make a 
satisfactory adjustment in all four areas: 
were rehospitalized, had not worked steadily, 
had had serious family trouble, and had not 
enjoyed good health. 

‘After each patient was evaluated with re- 
spect to the criteria, the main task of com- 
paring the predictors with the criteria fol- 
lowed, for each of the two rater groups and 
for each of the four areas studied. First, pre- 
dictions based on each of six monthly surveys 
were compared, one at a time, with the cri- 
teria. Next, average ratings for each patient, 
based on three to six monthly surveys, de- 
ng on length of hospitalization, were 
computed, and these averaged ratings were 
compared with the criteria. These averaged 
ratings will be called combined ratings. Fi- 
the last ratings which a patient was 
given during the month before he was dis- 
charged from the hospital were compared 
with the criteria. These last ratings will be 
called predischarge ratings. 

Chi square and Fisher’s Exact Method were 
used to screen the predictive efficiency of the 
monthly, combined, and predischarge rating 
distributions. This procedure eliminated the 
individual monthly peer and staff ratings as 
predictors of post-hospital adjustment since 
none of the p values are significant. An in- 
spection of chi squares for cells revealed the 
interesting tendency for patients to err on the 
side of being overly optimistic, while the staff - 
erred by being too pessimistic regarding the 
anticipated adjustment of the patients. Com- 
putations based on the chi square “predis- 
charge” cell values revealed that both pa- 
tients and staff had an average accuracy of 
70% in predicting adjustment in all four 
areas. 

The main findings of this study are pre- 
sented in Table 1, where it will be seen that 
14 of the 16 correlation coefficients are sig- 
nificant at the .03 point. In nine instances, 
the correlations are significant beyond the 
001 point. Staff raters were able to predict 
post-hospital adjustment at a level signifi- 
cantly greater than chance in all four areas. 
The patients predicted accurately for all ex- 


pendir 


nally, 
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Table 1 


Relationships Between Majority Opinion Prediction Ratings and Corresponding Dichotomized Post-Hospital 
Adjustment Criteria for Patient Raters and for Staff Raters * 


Prediction Ratings 


Combined 


Pere a 


Predischarge 


Adjustment Criteria Staff Patients Staff Patients 
I. Rehospitalization 
This 66 58 62 49 
Cest 14 16 AS: 17 
p -001 001 001 01 
TI. Work adjustment 
This -15 36 „86 39 
Test .12 19 .09 19 
p -001 03 001 02 
II. Family adjustment 
Tia 54 78 59 84 
Fest 16 11 16 10 
b .001 001 .001 001 
IV. Health adjustment 
Tois At 04 43 28 
Coat 19 22 19 21 
p 02 42 02 09 


* One-tailed test, V = 36. 


cept the area of health adjustment. Among 
the three areas of adjustment that both groups 
could predict, the staff was significantly more 
accurate (< .01) in predicting work adjust- 
ment than the patients, but the patients were 
more accurate jn predicting family adjust- 
ment (< .05), 

Next, the predictive efficiency was evalu- 
ated for each patient regarding himself, each 
patient regarding other patients, each staff 
member as a rater, and each professional 
group represented on the staff, 

Patient self-predictions did not reach the 
-05 point for any of the four areas of adjust- 
ment. 

The predictions of only two to four pa- 
tients on any one area of adjustment reached 
the .05 point. No patient was able to predict 
adjustment in all four areas consistently, 

The most accurate predictors among indi- 
vidual staff raters included the ward secre- 
tary, an aide, a recreation worker, a nurse, a 
psychiatric resident, and the two psycholo- 


gists. As far as individuals on the staff were 
concerned, ability to predict post-hospital ad- 
justment of patients was not significantly re- 
lated to professional background and training. 
All professional groups on the staff were 
able to predict work adjustment, with the 
exception of the occupational therapists (< 
.07). The two psychologists reached the .02 
point of significance on all four areas. Social 
workers did less well than most other staff 
groups in predicting family adjustment, reach- 
ing a nonsignificant level of .14. Nurses, aides, 
resident psychiatrists, and recreation workers, 
as groups, predicted significantly at beyond 
the .03 point on rehospitalization, work, and 
family adjustment, but each of these staff 
groups missed on health adjustment. 
Usually a statement regarding prognosis is 
made by the resident in charge of the case at 
the time of the patient’s discharge. This con- 
dition was approximated statistically in this 
study by tabulating the predictions made by 
each resident for his own patients during the 
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patients’ last month of hospitalization. While 
none of the predictions made by the five resi- 
dents, as individual raters, reached statistical 
significance, each resident’s predictions were 
an the right direction. Since the number of 
patients per resident was small, these data 
were pooled. Pooled residents’ ratings made 
during the patients’ last month of hospitali- 
zation significantly predicted only one of the 
four areas, rehospitalization, at beyond the 
-O1 point. i 

Other of the more usual prognostic vari- 
ables were compared with the criteria. For 
this sample, diagnosis, length of treatment at 
this hospital, and age bore no significant re- 
lationship to post-hospital adjustment. Num- 
ber of previous hospitalizations was & good 
predictor of rehospitalization (<.01) but was 
not a good predictor of work, family, or health 
adjustment, A rather unusual predictor was 
also evaluated. Biserial correlation coefficients 
Were computed between weight of C-files ° and 
criteria measures. The only criterion which 
the C-files did not predict at the .001 point 
Was family adjustment, and this they pre- 
dicted at the .05 point. The correlations 
ranged from .33 for family adjustment to 6 
for rehospitalization, with the mean correla- 
tion being .52. 


Discussion 


Psychological tests, objective 0° io 
Were not used in this study. Predictions Were 
derived from human interactions. Judgments 
based on these interactions were obtained by 
asking for a Yes or No response from all of 
the people concerned. 

During the first month or two 
ae of the patients had amen 
e fact that their opinions a” 
Were regarded as ‘eee worthwhile. Although 
no study was made of this feature, the a 
Pression was that the attitudes the ges : 
had toward the staff and toward them a 
might have become more positive aS = 

of participating in this study. 

The patient raters face! 
stacles. These included high rate ° 


3A C-file contains all the material oP wer 
compensation claims and allowances; end: Ve 


tary hospital discharge summaries. 


turnover and the inclusion of self-ratings, 
known in advance to possess little validity in 
this form, in the pool of patient ratings. Pa- 
tients did not have access to the detailed in- 
formation contained in previous and current 
hospital records, case histories, and test re- 
ports. 

The staff raters also faced some obstacles. 
Apparently there were sources and kinds of 
information which were available to the pa- 
tients but not to the staff. This is a problem 
area to be explored in its own right. 

Methodologically speaking, neither rater 
group, on any one monthly rating period, 
could make valid predictions. However, the 
predictions attained significance if one dis- 
tribution was constructed of ratings made 
during each patient’s last month of hospitali- 
zation, or if all monthly surveys were com- 
bined into one distribution. 

A methodological point which needs ex- 
ploration is to investigate how much addi- 
tional criterion information the raters could 
profitably use. The questions that were asked 
were simple and general. For example, “Will 
this man have serious family trouble?” The 
investigator could explain to one half of a fu- 
ture study population, “By serious family 
trouble we mean such things as this patient 
deserting his family, having long separations 
from his wife, obtaining a divorce, running 
around with other women or beating his wife.” 
The other half of the group could be asked 
the simpler question. 

It would be interesting to learn whether 
this general, rating by peers, approach could 
be applied in a psychiatric setting as it is 
done in a military setting; i.e., to collect data 
from a group of raters at one time, instead of 
individually. It is also interesting to specu- 
late what might happen if the ward secretary 
or the patients, for example, through their 
Patient Council, were asked to collect data 
for this type of study. 

As will be recalled, the patient’s own self- 
predictions were unreliable. This was expected 
on the basis of other studies (Taft, 1955) in- 
volving self-ratings. Several unexpected events 
occurred, however. Various staff occupational 
groups were not able to predict the area(s) 
closest to their area of specialization, while 
their staff colleagues in other occupational 
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groups were able to make these predictions. 
For example, social workers missed in predict- 
ing family adjustment. Occupational thera- 
pists missed in predicting job adjustment. 
Resident psychiatrists missed in predicting 
job, family, and health adjustment on their 
own assigned patients. Nurses, aides, and 
resident psychiatrists missed on the predic- 
tion of health adjustment. This raises a very 
interesting and broad question for further 
study. Do people lose some of their objec- 
tivity when they move close to themselves, 
or to their areas of professional competence? 


Summary 


Using a predischarge ratings by peers 
method, an open ward group of 36 psychi- 
atric patients were able to predict individual 
patient’s rehospitalization as well as their 
work, family, and health adjustment for a 
period of two years following hospitalization, 
with an average accuracy of 70%. The pa- 
tients’ staff of 21 members were able to pre- 
dict future adjustment in the same four areas 
with the same average accuracy of 70%. The 
patients were more accurate (< .05) in pre- 
dicting family adjustment, while the staff 
was more accurate (< .01) in predicting 
work adjustment. A biserial correlation co- 
efficient of .84 was obtained between predis- 
charge patient predictions of family adjust- 
ment and a two-year fellow-up criterion. A 
biserial r of .86 was obtained between predis- 
charge staff predictions of work adjustment 
and a criterion. 

_As individuals, no patient was able to pre- 
dict his own future adjustment nor was any 
patient able to successfully predict all four 
areas of adjustment for the other patients. 

Ability to predict successfully among indi- 
vidual staff members or among the various 
professional subgroups was not related to pro- 
fessional specialization but, rather, seemed to 
be a function of the individual’s ability to 
predict, per se. In the nature of a trend, it ap- 
peared that various professional groups were 
less able to predict the area of adjustment 
most closely related to their own area of spe- 
cialization than were their staff colleagues. 
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Predictions based on single monthly ratings 
did not reach significance. Fourteen of 16 bi- 
serial correlation coefficients based on predis- 
charge, or on combined (three to six monthly 
group ratings combined into one distribution) 
ratings were significant at beyond the .03 
point. 
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fon seeing another's personality character- 
ever recor ape various cues, generally without 
ent che E the cues themselves. Difier- 
from einige are likely to be judged 
ford Rota es cues, and some cues may af- 
ae information than others. Here, ac- 
Rive : ive information conveyed by succes- 
sg esentation of four cues (voice, gestures, 
with = social interaction) was evaluated 
intelli ings on the following characteristics: 
tivit gence, affective tone, sociability, produc- 
aus Questions were asked with regard to 
meses among ratings, the influence of 
the a ional cues on ratings, the significance of 
oa of previous ratings, and the 
ac Parison of “first impression” with “long 
th uaintance” ratings. Asch (1946) stressed 
me of the first judgment and its 
CEEP on succeeding judgments. Newcom 
o described the factors which enhance 
py, pa onal attraction as frequency of inter- 
Bea perception of reciprocated attraction, 
oes combinations of personality rire 
i and attitudinal agreement. A pore 
oe (1933) studied perception i 
in Uy expression and facial expression, g 

g attention to the emotional impact an 
cone of agreements in judgments. Wolff 
X Ta was concerned with agreement ren 
gi 2 which expressions and behaviors Be 
ie individual belong together. Again, he 
c es for each judgment were not of mi 
ea Secord, Dukes, and Bevan (1954); 
ae (1946), and Newcomb (19 
ue interpersonal perceptio 
ened with the specific Cues, ) G 
t e formulation of judgment but investigate 
a e cues within one event, for example, 
acial expression. Gage (1952) studied judg- 
he i U. S. 
e AOA me 


e e authors are indebted to Lyle E. Bo 
S assistance with the analysis of the data. 


urne for 


ments of interests from expressive behavior 
through Kuder ratings given to the “judges” 
and “strangers” and discovered that the 
judges were fairly consistent in their ratings 
of five expressive tasks. While Gage’s study 
appeared to be similar to the present study, 
it appeared that no study has used accumu- 
lative cues and the question of this consist- 
ency as a basis of research. In two investiga- 
tions on the “Response to the human face as 
a standard stimulus” (Beier, Izard, Smock, & 
Tougas: 1953; 1957) “liking” and “dislik- 
ing” ratings were used to investigate how 
judgments were formed in reaction to the hu- 
man face. The present study was an expan- 
sion in two ways: instead of the face only, 
accumulative cues were introduced, and in- 
stead of a liking—disliking rating, a four-area 
rating was introduced. 

Specifically, the present study investigated 
the following questions: 

1. If four areas of personality character- 
istics (intelligence, affective tone, sociability, 
and productivity) were judged, would judg- 
ments remain constant as the judges (J) re- 
ceived cues cumulatively from observing the 
participant’s (O) (a) voice, (b) gestures, (c) 
facial expression, and (d) interaction with the 
judges? 

2. Would those judgments which did not 
remain stable become stable with some par- 
ticular accumulation of cues, i.e., what was 
the minimum information the J needed in or- 
der to reach a stable decision? 

3. Would the staggered introduction of rat- 
e characteristics have any influence 


ings of th i 
nd in which the characteristics were 


on the tre 
rated? 

4. How did ratings of personality charac- 
teristics derived from first impressions differ 
from ratings made by individuals who knew 
Os for a long period of time? 


zig 
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Table 1 
Percentage of Student’s Agreement on Selecting Words for a Given Characteristic 
(N = 43) 
Characteristic Positive Negative g 
— Intelligence bright 100% thoughtless 55% 
(1) contemplative 100% incapable 90% 
gifted 100% stupid 100% 
Affective Tone wholesome -~ 100% unhappy 100% 
(A) content 100% miserable 90% 
open 60% hopeless 100% 
Productivity industrious 100% unreliable 60% 
(P) practical 70% distractible 55% 
organized 80% slipshod 80% 
Social cooperative 100% revengeful 100% 
(S) hospitable 100% unfaithful 100% 
courteous 100% standoffish 100% 
Note.—These ratings came from an unpublished study dana at Syracuse Univ We are presently engaged in a new 


project where we havi 


Procedure 


The task was (a) to develop an instrument 
to obtain ratings of the four personality char- 
acteristics, (b) to select Os as the subjects to 
be judged, (c) to devise a proper method of 
cue presentation, (d) to administer the in- 
strument and cue presentation to the Js, and 
(e) to obtain ratings from a long acquaint- 
ance group. 

1. Judgments were rated with words de- 
noting four characteristics of personality: in- 
telligence, affective tone, sociability, and pro- 
ductivity. The four characteristics themselves 
represented an arbitrary choice from among 
a large number of possible personality charac- 
teristics. The words had been gathered in the 
following manner: some 60 undergraduate 
students were given the task of writing down 
as many words as they could think of under 
each of the four characteristics. Each of the 
words was counted for the number of times it 
occurred under one heading. If it occurred at 
least 30 times (e.g., if at least 30 students 
wrote “bright” under “intelligence”) it was 
used in a second alphabetical list of words. 
This list was presented to 43 undergraduate 
students who were given the task of assign- 
ing each of these words to one of the four 
characteristics. From the number of students 
who placed a given word into the selected 


© reason to believe that there are regional differences in such ratin, 


characteristic, percentages of agreement were 
calculated for each word. 

For the rating scales in the present study 
six words were selected for each of the four 
characteristics. There were three “positive 
and three “negative” words for each charac- 
teristic. Each word was placed on a seven- 
point scale, the endpoints of which were called 
“Jeast” and “most.” The range of scores for 
the six words of one characteristic accordingly 
was 6-42. The group of words representing 
each of the four characteristics were ordered 
in such manner that four different booklets 
for administration were constructed. The first 
page would contain only one group of words, 
the second page two groups, the third page 
three groups, and the fourth page four groups. 
Each of the four booklets contained a differ- 
ent sequence of characteristics as can be seen 
in Table 2. 

It was necessary to construct these different 
booklets to test whether the occurrence of a 
previous rating would influence the value of 
following ratings. Additionally, each of the 
four pages of all booklets contained a like- 
dislike scale, and space was left for com- 
ments and suggestions. ae 

2. It was decided to use the junior jani- 
torial help active at the University, some p 
whom planned to go to college and some di 


Fars 


Cues to Personality Characteristics 


Se Junior janitors from the University 
clinical — PND the MMPI test. Three 
paired EENE using the method of 
most di omparison selected the four subjects 
The rie in the characteristics to be rated. 
each who appeared most different from 
were m i r were selected for the study. They 
3 a e, between the ages of 16 to 19. 
ents s O was presented to a class of stu- 
cessive] lig various cues were introduced suc- 
with y. For this purpose a stage was built 
ered an attached curtain which could be low- 
is an raised. A screen shielded the O upon 
er from the view of the class. After the 
ap ntation of each cue Js rated O on the 
in Propriate page of the booklet. The follow- 
8 cues were introduced: (@) Voice. Hidden 
ais curtain, O talked to the class for one 
the ns . The talk was spontaneous since 1n 
soned sence of reliable knowledge it was j= 
re that a memorized talk would be too tar 
‘Moved from a life situation. he O was 
Siven the topic of marriage to discuss. Thus; 
oe Was not only a voice presentation but 
ti msmitted attitudes and opinions of the pat 
cipant. (b) Gestures. The second cue intro- 
Pai voice presentation with gestures. The 
the ain was raised so that arms, h 
visible’ a, torso between neck a 
a Another topic, “father doe no 
wi give car to son” was presente o 
ith the instruction that he us 


freely in this demonstration. Again 4 
Mation contained more cues than could be 
Y ae from gestures alone, and so the cue 
 ageneagees misnamed. Perhaps 5° 
ine = less spontaneously ss 
thei hat they had to “overact 
K ir hands. This cue, on th S 
por to have been a fortun 

‘ace. Immediately following the 


Table 2 


_Bovklet Characteristics 
E ane aes F 
1 I IA JAS IASP 
3 A AS ASP IASP 
Ss f ISP TASP 
2 P oF TASP 


TAP 


aot 


gestures the curtain went up and O’s torso 
from the waist to the face was exposed to the 
Js. The O was told to look straight ahead and 
to refrain from any facial expression. After 
one minute exposure, the curtain was drawn 
and Js were instructed to make their third 
page ratings. (d) Interaction. The O was in- 
structed to involve the class in a three-minute 
discussion of “cheating.” The class was en- 
couraged to respond. Most Os addressed the 
class for a minute and then asked questions. 
With this cue it is likely that attitudes and 


opinions were communicated in addition to 


the interaction. Generalization from this study 
will have to take this into consideration. 

“4. The 240 Js were male and female stu- 
dents from the University College and the 
School of Education of the University of 
Utah. The Js were given some over-all infor- 
mation on the project and asked to rate Os 
after the introduction of each cue. At the 
same time ratings on a like-dislike scale, and 
comments were requested. 

5, The rating scale containing all the words 
was sent to four people whose names had been 
supplied by each O. It should be noted that 
this obviously would not represent a random 
group of long acquaintances but rather a 
highly selected group of people who would 

redictably react more positively toward O. 
The E told the long acquaintance Js that 
their ratings would be strictly confidential and 
would not influence the University’s attitude 
toward O. All but one of the long acquaint- 
ances responded. These ratings were not 
thought of as accuracy ratings. The person 
who knew another person longer was not as- 
sumed to be more accurate in his observations 
though he did pase his impression on a larger 
amount of information. The data was col- 
lected as a pilot study as the plan had been 
to develop eventually a design which would 
test accuracy data. Here one would learn 
about differences in ratings based on first im- 
pression made in a setting which could be ex- 

ected to sponsor fairly objective attitudes 
(students participating in a scientific study) 
and ratings based on at least one year of ac- 
quaintance in a setting which would probably 
favorable attitudes. With the knowl- 
hese limitations in mind, the investi- 
mined the differences among the 


sponsor 
edge of t 
gators exa 
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Table 3 
Means of the First Four Consecutive Ratings on Each of the Four Characteristics 
Sociability Affective Tone Intelligence Productivity 

ao E & E & > © E 8 > 6 € & Š E s 
1 31.2 31.0 326. 33.3 35.3 32.5 35.2 36.0 29.1 29.6 33.4 36.7 7 29.7 33.5 35.7 
2 31.0 30.8 31.46 31.7 26.73 30.0 31.3 32.7 26.9 26.2 274 271 25.2 27.8 27.0 aoe 
3 30.5 30.2 30.8 32.6 268 29.7 26.93 29.73 24.7 25.5 27.7 283 251 265 266 2o 
4 29.6 29.8 29.0 31.0 28.0 29.7 30.8 32.7 27.2 26.7 27.9 28. 


31.73 31.0 31.8 31.7 


Note.—N of 15 for each mean. 


four characteristics as rated by the two 
groups. 
Discussion of Results 


Each of the four Os was judged by a group 
of 60 Js. Each of these groups was subdivided 
into four sections of 15. Each section was sup- 
plied with a different booklet (see Table 2). 
In this manner a total of 240 x 60 = 14,400 
scores were obtained. This number was re- 
duced to 2,400 by obtaining a sum of scores 
for each of the six words comprising a group. 
Three booklets had not been completed, and 
the scores for these booklets were averaged as 
all booklets were needed for the analysis of 
variance. Another deficiency in scale construc- 
tion was discovered in that in 15 booklets one 
word was left out in one of the pages and, ac- 
cordingly, only five words for the character- 
istic were averaged. A third error was in- 
troduced by the arrangement of the scoring 
sheet: a few semiattentive judges failed to 
maintain constancy and apparently exchanged 
the meaning of “most” and “least” occasion- 
ally.* 

It should be remembered that the scores for 
each characteristic for each pamphlet were or- 


dered in such a way that a group of Js rated 
this characteristic four times 


other, three times successivel 
two times successively; and 
only once. 


successively; an- 
Y: a third group, 
a fourth group, 


2 There was an attempt to correct these apparent 
slips, but only seven scores out of the total 14,400 
were changed under rigorous criteria: (a) the score 


had to be extreme as, eg., five “7” 


scores and one 
ug» 


score, (b) there was constancy on all other 
characteristics, (c) there was extreme constancy (7 
or 1) on all following pages within this characteristic. 


Three separate analyses of variance were 
performed on this data. The first is an analy- 
sis of the differences among four successive 
ratings on all characteristics for Os. The sec- 
ond is an analysis of the effects of previously 
available but unrated cues on Js first rating 
of O. The third measures the differences in 
final ratings after a varying number of previ- 
ous ratings had been made.‘ In the following 
the basic description data will be presented. 

The first analysis based on the means values 
of Table 3 was designed to answer the ques- 
tion of the change in the four ratings for all 
Os for the four succeeding cues, It can be 
concluded from the significant differences 
among the means of Os (F: 9.90, p > -01) 
that one of the assumptions of the test 15 
met—that the Os are not alike in the critical 
characteristics. The finding that the interac- 
tion between Os and characteristics was not 
significant was interpreted to mean that while 
each O obtained different mean ratings, the 
characteristic profiles for each showed „the 
same general trend on the consecutive ratings 
of each characteristic. Ss/groups term oe 
12.36, p > .01) indicated that the Js sang 
individual differences in their ratings as 
was hoped they would. The trials term ( a 
31.24, p > .O1) presents a rather interesting 
finding. As can be seen from the means toe 
is not only a change across the ratings in t d 
four cues, but the trend is constantly tower 
higher ratings. It appeared that cither the ac 
cumulation of cues gave increasingly more 

4 The three tables of this analysis of variance m 
been filed with the American Documentation m 
tute. Order Document No. 5837, remitting $1.25 
microfilm or $1.25 for photocopies. 


gi 


Cues to Personality Characteristics 


positive information, or, otherwise the fact 
that the Js have more cues available—per- 
mitted the Js to express more favorable rat- 
ings on all characteristics. The T X O inter- 
action (F: 13.35, p > .01) indicated that all 
ratings combined change for each O over the 
four trials. The .01 level of confidence was 
accepted for this study, so T X Ch (F: 2.05, 
p > 05) cannot be called significant. This 
would have to be interpreted that, while the 
ratings differ, the characteristics seem to have 
the same stimulus value on succeeding trials. 
By and large, there is little residual variance, 
indicating fairly high consistency among the 
ratings of Js. 

In these means (Table 4) it should be 

noted that the J has seen the previous cues in 
the sequence but had not had the opportunity 
to rate the same cue on the given character- 
istic, as ratings were introduced later on. The 
analysis deals principally with the hypothesis 
that previous available cues will have an ef- 
fect on the J’s first rating of the O. 
_ The O (F: 22.73, p > .01) and character- 
istic (F: 11.35, p > .01) sources of variance 
again indicate that Os differed significantly 
among themselves, supporting the selection 
Process and that the characteristics differed 
from one another. The significant finding on 
Cues (F: 11.40, p > .01) was interpreted to 
mean that the more cues the J has available 
to him before he attempts to rate, the higher 
will be the rating, a finding which is easily 
Supported by an inspection of the means. 

It becomes evident that the ratings did not 
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become more favorable because of previous 
ratings, but primarily because of previous 
cues. The finding suggests that Js formed 
judgments of other people regardless of 
whether or not they were specifically asked 
to do so. 

The significant O X Ch interaction (F: 
3.61, p> 01) was interpreted as follows: 
while the Os have the same general profile on 
the consecutive ratings of each characteristic, 
the profiles differ when based on the staggered 
“first ratings” only. In other words, there is 
greater heterogeneity in the profiles of the 
Os based on data of first ratings from Js who 
had 0-3 previously unrated cues, and greater 
homogeneity when the cue was rated each 
time it was presented. Apparently, here, the 
very fact of rating had a constricting effect. 

The O X Cu (F: 1.63, not significant) and 
Ch x Cu (F: 151, not significant) interac- 
tions support the finding of consistency of 
ratings. 

The main question to be answered by the 
analysis of these means deals with the differ- 
ences in final rating after various number of 
previous ratings have been made. ; 

Support was found for the previous finding 
that Os were significantly different from each 
other (F: 34.02, 2 > .01) and that the char- 
acteristics differ (F: 10.42, p > 01). The 
finding of lack of significance between the 
means of previous judgments support the 
previously reported interpretation that the 
fact that a person rated a characteristic previ- 
ously does not contribute to the differences 


Table 4 


haracteristic on the Stagge 


red Introduction of Cues 


Mean of Ratings for Each C 
Intelligence Productivity 
ive Tone 
Sociability Affective 
2 S z ae z 2 è S 
à i ž z ae EA A P a8 %, A A = 
» % yh 8 b Ev & EE j Eg £ £3 £ Eo £ 33 
S bp 28 2 gB 3 32 Jg gagas 28 35 Sg SŠ 
ge RI 8 3a 3. B3 gg gs Ma HB ag ae 22% 23 28 
ag eB Sg gs ag mg as 24 gp #9 3H 3 BF Pte) Ze Ze 
g> go gi ga BF EE EPET Bg Es gs ES ÉS TETET 
O H&S HS ES is Bs Bo Re z 3 z = z 3 F g 
aT 357 291 29.9 339 353 327 29.7 32.9 34.4 
? oa a sie ae me pe $5) 969 297 274 301 25.2 264 25.7 27.7 
3 $0 319 315 315 26 Goa 20 ae MI Da 217 80 251 280 255 285 
fete eS pg ms MA als 28.0 26.2 30.9 28. 2 290 28.5 31.7 


Note.—N of 15 for each mean. 
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Table 5 
Means of Ratings of All Characteristics on the Final Cue: Interaction 
Sociability Affective Tone Intelligence Productivity 

PA a 

5 a = m i 2 5 

on EES : pf Fo id 
È ÈE A R AL ALA A, Pa BM, g a 
gigs aise Ze a8 3: gesegiie 2Pab sp se 
338 33 323 33 235 3283 sa 32223 g3 23 33 23 
os BEEZ B3 53 32 52 5 eh 22 2252 ES 58 58 Bd 
1 33.3 34.1 32.7 345 36.0 34.5 334 35.7 36.7 34.6 35.5 35.3 35.7 34.1 35.0 par 
2 31.7 348 33.7 31.5 32.7 32.4 32.3 33.9 271 264 275 30.1 26.7 26.7 28.8 aT 
3 32.6 29.8 304 29.1 29.7 31.5 29.8 32.4 28.3 27.5 29.2 28.0 26.4 29.9 28.0 eae 
4 31.7 32.0 35.7 304 31.0 345 31.5 31.5 32.7 29.5 305 28.4 28.9 29.6 29.0 31. 


| 


Note.—N of 15 for each mean. 


among ratings. Instead, it supports the view 
that the number of cues is the main con- 
tributing factor. The significant O x Ch in- 
teraction (F; 3.89, p> 01) indicated that 
the profiles of the four Os differ significantly 
in the final rating due to the varying number 
of previous ratings. In other words, while the 
Os have the same profiles on the consecutive 
ratings of each characteristic, the end result, 
i.e., the ratings on this last cue alone, do show 
difference as previously the staggered “first 
ratings” alone have shown differences. The 
Os appear similar in their general profile 
trend, but dissimilar in the values which make 
up their profiles, somewhat analogous to a 
paradigm of parallel wavy lines. 

The lack of significance in O X R and Ch 
X R to all interactions with ratings gave sup- 
port to the argument that previous cues, but 
not ratings, were the important determinator 
of the value of these ratings. 

In Table 6 the trend generally indicated an 
increase in liking as more cues were presented, 
perhaps supporting the finding of increased 
favorable ratings. In two subjects (1 and 4) 
the means presented a clearly descending line, 
while in Subjects 1 and 3, only the final cue 
introduction shows an increase in “liking.” 
The “gesture” cue seemed to contradict the 
trend most markedly, possibly because of its 
forced content, O was instructed to give em- 
phasis to their talk by gestures. It might be 
desirable to select a more harmonious cut in 
the future as the forced behavior might bring 
intervening variables into the ratings. The 
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comments made by the rating Js stimulated 
the investigators to think along the lines of a 
more “personalized” rating system in which 
the Js themselves would contribute their char- 
acteristics to be rated. 

Finally, in a comparison of the ratings of 
the four Js of “long acquaintance” with the 
“first impression” Js, it appeared that three 
out of four subjects were underrated on all 
characteristics by the “first impression” Js- 
Only one subject was overrated by these Js, 
as compared to the “long acquaintance Js. 
While the number of “long acquaintance 
Js is too low to warrant an analysis of the 
data, it might be speculated that higher rat- 
ings of the “long acquaintance” Js may be at 
least partially due to the setting, where the 
60 “first impression” Js had no stake in then 
judgment, while the “long acquaintance” Js 
were selected by the Os as people friendly to 
themselves and perhaps wanted to give as fa- 


Table 6 
Means{of Ratings on Like-Dislike Scale 
by All Js on Four Os 
(N = 60) 
Inter- 
Subjects Voice Gestures Face action 
1 3.12 3.57 3.03 an 
2 3.66 3:00 2.92 2. 3 
3 3.63 3.73 3.78 Ae 
4 3.50 3.35 3.05 2.85 


Note.—Rating scale 1-7; most liked to least liked. 
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Cues to Personality Characteristics 


Se ratings as possible. It would be in- 
pe to discover to what extent the length 
hs of acquaintance really influenced the 
E gs and if the suggested tentative hypothe- 
i Does familiarity breed appreciation?” 
ens empirical basis. Social class may very 
Differer a factor in influencing judgments. 
= hig in social class between J and (0) 
The : whee significant variable to be studied. 
telli ges used here were above average 1n- 
as gence, The intelligence of the Js as re- 
ated to the intelligence of the Os should be 
another factor reflected in the ratings. Age is 
Aad another factor in the present study; all 
Se considerably older than the Os. These 
he questions which should be considered in 
ure research, 


Summary 


to In this study each of four Os were shown 
ch groups of 60 Js for ratings of personality 
Fee nists, The Os were presented under 
ifferent cues. First the Js heard only O's 
paces second, Js also saw O’s gestures; third, 
S saw O’s faces; and fourth, Js participated 
With O in a discussion. After each of the cue 
Presentations, the J had to rate the O on onè 
or more characteristics. The rating scales wet? 
Composed of words connoting intelligence, af- 
lective tone, sociability, and prodno e 
ey were devised in such a manner ma: 
€ach characteristic would occur once Ge 
Once second, once third, and once on ae a 
Cue only, In addition, ratings from NE 
acquaintances” were obtained for each of the 
Participants. 

To the first question, which judgments 1e- 
moaihicanetant: ander accumulation cue pres- 
entation, it was found that ratings for all ie 
and all participants generally oe a 
crease toward more favorable ratings: the 

The second question, whether oF not E 
ratings level off with particular cit and fin 
ticular characteristics had to be sors i 
the negative. d in- 

A third question, whether the staggere Id 
troduction of ratings on characteristics wou. 
influence the consequent ratings Was answere! 
in the negative. No significant influence was 
discovered. h differ 

The i oe e 

fourth question, concerned and long 


e í 4 
poas between first impression ra i 
Cquaintance ratings was answered by inspec- 
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tion only. It appeared that by and large the 
long acquaintance ratings were more favor- 
able than first acquaintance ratings. 

A few critical comments with regard to the 
study should be considered. One was the set- 
ting—the J worked in a group setting which 
may have minimized cue information gained 
on first impression. They also worked in a 
reasonably objective setting where they did 
not have to commit themselves, which is dif- 
ferent from the “long acquaintance” who were 
likely favorably inclined toward the Os. The 
very conformity of the increase in favorability 
of the ratings for all cues and all Os was in- 
terpreted to mean that Js may have a com- 
mon pattern to meet the stranger: “caution” 
and then “greater acceptance.” It was thought 
likely that the group setting, the lack of in- 
volvement in the ratings, and the above av- 
erage intelligence of the Js and the approxi- 
mate homogeneity of their social class were 
more important determinants of the value of 
the ratings than individual difference of the 
O. Future research on these “setting cues” is 


recommended.° 
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THE FACTORIAL DIMENSIONS OF THE MMPI: 


GENE G. KASSEBAUM,? ARTHUR S. COUCH, ann PHILIP E. SLATER 


Harvard University 


The complex domain of personality has 
been subjected to numerous attempts at sim- 
plification through factor analytic techniques, 
but the results of these efforts have been 
somewhat disappointing to those who had 
hoped in this way to achieve major concep- 
tual advances. Comparison of a sample of 
such studies often leaves the reader somewhat 
disheartened at the lack of continuity that he 
finds. 

Careful reviews, such as that of Eysenck 
(1953), suggest, however, that the picture 
may be less black than it seems. Eysenck 
stresses the frequency with which the same 
two major Personality factors have been iso- 
lated by investigators working with very dif- 
ferent kinds of instruments and variables. He 
points out that similarities in results are often 
masked by Variations in rotation Positions, or 
by failure to carry out second-order analyses 
of oblique solutions, Even when solutions are 
similar, differences in the conceptualization of 
the factors imply a greater disparity between 
experiments than actually exists. 

The first of the two recurrent factors ob- 
served by Eysenck suggests a dimension of 
€go-weakness vs. ego-strength, or, in Eysenck’s 
terms, “general neuroticism” vs. “will.” The 
second factor seems best defined by Jung’s 
bipolar conception of introversion-extraversion 
(Jung, 1924; Eysenck, 1953, p. 318). 

Factorial studies of the Minnesota Multi- 
phasic Personality Inventory have until re- 
cently failed to approximate this general 
trend. A recent volume by Welsh and Dahl- 
strom (1956, p. 264) lists eight factorial stud- 
ies of the MMPI, and Welsh comments: 


1 This research was carried out under the direction 
of Robert F. Bales. The larger project of which the 
study is a part was facilitated by the Laboratory of 
Social Relations, Harvard. Funds were supplied by 
the Rockefeller Foundation. 

2? Now at Cornell University Medical College. 


In almost all the studies there is essential agree- 
ment as to the loadings of two factors although the 
interpretations and the name assigned to these fac- 
tors vary. One factor (usually the first) shows very 
high loadings on . . . (Pt) and... (Sc) with ee 
tive loading on scale K whenever it is used. A secon 
factor shows fairly high loadings on the neurotic 
triad, especially . . . (Hy) and... (D), with nega- 
tive loading frequently appearing on... (Ma). 

Unpublished studies have been carried out (bY 
Welsh) on three different populations . . . all three 
studies confirm very clearly the factor loading pat- 
terns outlined above. 


For the most part these studies were re- 
stricted in scope to the original clinical scales, 
and it was difficult with so few scales to de- 
fine the factors clearly. More recent studies 
have profited from the development over ma 
past decade of a large number of nonclinica 
scales. These provide wider coverage of the 
domain of personality than does the original 
battery, which was concerned primarily with 
the diagnosis of pathological phenomena. We 
will discuss these studies after first presenting 
our own research, 


Procedure 


This research grew out of a long-term lap 
ratory study concerned with the prediction 0 
interpersonal behavior in small groups. A pre- 
liminary goal of this research was to spa 
a clarification of the dimensions of the MMP. 
in more general terms than the clinical po 
phasis of the test has heretofore allowed. on 
this purpose we included 19 nonclinical sca i 
in our analysis in addition to the original i 
clinical and validity scales. The selection o 
these scales was based upon our interest 1n 
predicting certain aspects of interpersonal e 
havior, and this concern determined the do 
main of scales to be analyzed. Some scales 
have not been as fully validated as might = 
desired, while others, such as Gough’s Pe 
scales (1957) are not fully represented in 
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as of the scales have a number of items, however, almost obliterates some scales 
Ei aen and the intercorrelations (Welsh et al., pp- 264-281), and the validity 
devas, n these scales are undoubtedly exag- of these truncated scales is problematical. The 

ed thereby. Removing all overlapping authors felt that retention of overlapping 


Á i 
k P F s D Hy Pa Mf Pa PL Sc Ma Si Es Ie Lp 


Table 1 
a Intercorrelations of 32 MMPI Scales 
a 
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items was the lesser of two evils, but in any 
case the close correspondence noted below be- 
tween this study and a study using truncated 
or “prime” scales suggests that the practical 
significance of the problem posed by item 
overlap may have been exaggerated. 

The 32 scales used are as follows: 


L—Lie; F—Validity; K—Ego functioning; Hs— 
Hypochondriasis; D—Depression; Hy—Hysteria; Pd 
—Psychopathic Deviate; Mf—Masculine-feminine in- 
terest; Pa—Paranoia; Pt—Psychasthenia; Sc—Schizo- 
phrenia; Ma—Hypomania; Si—Social Introversion; 
Es—Barron’s ego strength scale (1953)—predicts re- 
sponses to psychotherapy; Ze—Gough’s intellectual 
efficiency scale (1957)—a “nonintellectual intelligence 
test”; Lp—Oettel’s leadership scale (1952); Ai— 
Gough’s “achievement via independence” (1957) — 
predicts academic achievement in introductory psy- 
chology courses; Sy—Gough’s sociability scale (1957) ; 
Ac—Gough’s “achievement via conformance” (1957) 
—predicts academic achievement in high school; Re 
—Social responsibility scale (Gough, 1957); Do— 
Dominance scale (Gough, 1957) ; Pr—Gough’s preju- 
dice scale (1951); St—Gough’s status scale (1948) ; 
Im—Impulsivity (Gough, 1957) ; $p—Social presence 
(Gough, 1957); Fm—Hecht’s feminine masochism 
scale (1950); Rp—McClelland’s role-playing ability 
scale (1951); R—Welsh’s factorial scale of “repres- 
sion, denial” (Welsh & Dahlstrom, 1956, pp. 264- 
281) ; A—Welsh’s factorial scale of “anxiety” (Welsh 
& Dahlstrom, 1956, pp. 264-281) ; Dp—Navran’s de- 
pendency scale (1954) ; To—Tolerance scale (Gough, 
1952) ; O-I—Originality potential (Gough, 1952). 


The test was administered to 160 Harvard 
College freshman and scores obtained on these 
32 scales. The mean scores for this sample 
approximate college norms for scales where 
such norms are available, 

The 32 scales were intercorrelated and the 
matrix factor analyzed by means of the com- 
plete centroid method of Thurstone (1947). 
After the extraction of the third centroid, two 
criteria indicated the undesirability of further 
factoring: (a) the third factor accounted for 
only 5% of the total variance, and (b) the 
third factor residual matrix did not contain 
significant coefficients beyond the number ex- 
pected by chance. The matrix was then ro- 
tated to simple orthogonal structure. 


Results and Discussion 


Table 1 shows the intercorrelation matrix, 
and reveals the generally high correlations be- 
tween scales which other investigators have 
found. 
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Tables 2 and 3 reproduce the centroid and 
rotated loadings, respectively. 

In Table 3 the main elements in the inter- 
pretation of Factor I are readily apparent. 
High saturations may be noted with regard 
to Pt, Sc, and Welsh’s A (Anxiety), thus pro- 
viding a close match with previous studies. 
High negative loadings are contributed by 
Lp (Leadership), To (Tolerance), Es (Ego- 
Strength), and Je (Intellectual Efficiency). 
We have defined this factor as a dimension 
of Ego Weakness vs. Ego Strength. Factor I 
accounts for 39% of the total variance and 
72% of the common factor variance. 

Factor II exhibits high positive loadings 0n 
Welsh’s R (Repression), Re (Social Responsi- 
bility) and Si (Social Introversion) and nega- 


Table 2 
Centroid Factor Loadings 

a — er 
Ttem No. I 1T 1I hi 
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2 F 65 -07 —.20 a 

3 K =i 17 19 2 

4 Hs 55 13 31 = 
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8 Mf 48 24 27 A 

9 Pa 34 18 25 a 

10 Pt 91 07 14 Ha 
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12 Ma 48 61 18 S 
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14 Es =e A 4,00 ee 
15 Te =1% 0s 18 a 
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18 Sy —.56 — 43 38 “48 
19 Ac —.63 29 03 
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21 Do =s —.18 09 5 
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23 St —49 32 30 p 
24 Im 59 —.51 23 A 
25 Sp =i =35 28 67 
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27 Rp S68 0 24 ei 
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2 A 88 03 .02 i 
30 Dp 85 08 12 “30 
31 To — 80 32 24 3 
32 OI —.32 24. =I ne 
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Table 3 


Rotated Factor Loadings 


Ttem I II m h 
3 L 12 21 
Z —91 AT 
K 24 37 
4 Hs 34 42 
5 D 28 66 
7 ay 37 33 
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1 Sc 00 80 
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interpretation of this factor in terms of In- 
Factor TI accounts 


19% of the 


Common factor variance. 
is EA most important loading 
y, which has low saturations 0D A 
} dings is of Sui 
cient size or purity to be of substantia 
us interpretation of the factor. 
a note that the factor has ! 
ee members of the “neuro 2 ; 
i us very similar to the so-called neurotic 
eer oneone of the early studies. Other 
pes however, such as the positive loadings 
n To (Tolerance) and Ai (Achievement via 
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independence) and the negative loading on 
Pr (Prejudice), suggest that the factor may 
be absorbing nonpathological elements from 
the clinical scales—an illustration of the haz- 
ards of factor interpretations based on clini- 
cal scales alone. We do not feel that a clear 
interpretation of this factor is possible at pres- 
ent, but have tentatively called it Tender- 
Minded Sensitivity. Because of its small size 
(it accounts for only 5% of the total variance 
and 9% of the common factor variance) and 
doubtful interpretation, Factor III was not in- 
cluded in the further analyses which are dis- 


cussed below. 


The Identification of Introversion 

The first of these three factors, Ego-Weak- 
ness VS. Ego-Strength, has been isolated with 
such regularity in previous work as to be non- 
problematic. Since Introversion—Extraversion 
has not heretofore been mentioned in con- 
nection with factorial interpretations of the 
MMPI, we shall discuss this identification in 
more detail. 

The negative end of the factor, with high 
loadings 0n Ma, SY (Sociability) , Im (Im- 
pulsivity); St (Social Status) and Sp (Social 
Presence) may be readily identified with ex- 
traversion. The positive end, however, seems 
to contain a variety of scales whose common 
element is difficult to perceive. For the clus- 
tering of four of these positive loadings—D, 
Si, Ac (Achievement via conformance), and 
oO-I (Originality potential) —we find consid- 
erable support from Eysenck, who quotes 
Guilford as saying: “It would seem that there 
is some basis (i.e. their high intercorrelation) 
for lumping together some characteristics bor- 
dering on seclusiveness with some implying a 
thinking person and still others that indicate 
depressed emotional tendencies and calling the 
resultant the introvert” (Eysenck, 1953, p. 
104; Guilford & Guilford, 1939, p. 34). 

The tendency of Factor II to split Ego- 
Weakness into “behavior disorders” (mania, 
impulsivity) and “neurotic disorders” (de- 
pression, feminine masochism) echoes studies 
cited by Eysenck (1953, pP- 60, 89-91, 125) 
as lending support to the psychoanalytic defi- 
nition of introversion as superego predomi- 
nance over id activities and extraversion as 
id predominance over superego activities. 
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Such a notion would help to explain the posi- 
tive Factor II (Introversion) loading on Re 
(Social Responsibility) . 

No interpretation of Factor II will be ac- 
ceptable, however, if it fails to take into ac- 
count Welsh’s R scale, which boasts the high- 
est loading on Factor II and is virtually the 
only variable which is independent of Factor 
I. Inspection of the items in this scale sug- 
gests that Welsh’s tentative label “repression, 
denial” is somewhat misleading, and that the 
terms “inhibition” or “constriction” might be 
more appropriate. The statements which are 
“denied” fall largely into two categories: (a) 
interest statements of a wide variety, such as 
“I like mechanics magazines,” “I like dra- 
matics,” and “I think I would like the work 
of a building contractor”; and (b) expres- 
sions of hostile, gregarious, and excited feel- 
ings, such as, “At times I feel like smashing 
things,” “At times I am full of energy,” “I 
enjoy social gatherings just to be with peo- 
ple,” and “I enjoy the excitement of a crowd” 
(Welsh & Dahlstrom, 1956, pp. 271-272). 
These statements would seem to appeal di- 
rectly to the extravert, who is expressive and 
labile, and cathects new activities easily. The 
more cautious and inhibited introvert, who is 
slow to change, and seeks his satisfactions in 
his own inner life, would tend to reject state- 
ments of this kind (Eysenck, 1953, p. 21). 

There is another characteristic of the R 
scale which | is worthy of note, namely, that 
an Ba are counted when marked 

ise. s equally true of the Lie scale, 
which also has a substantial loading on Fac- 
tor I. Furthermore, when we examine the 
Mania and Depression scales (which have so 
often marked the two poles of this factor) we 
find that the Mania scale contains signifi- 
cantly more True items than the Depression 
Scale (chi square = 17.64, p < .001). This 
suggests the possibility that what we Taye 
labelled extraversion is associated with a gen- 
eral tendency to agree with any item what- 
ever the content, while what we have called 
introversion involves a converse tendency to 
disagree or mark False. i 

This line of thought was prompted by an 
unpublished analysis by Couch and Keniston 
of a 360-item personality inventory, in which 
they found that the total number of positive 


„Gene G. Kassebaum, Arthur S. Couch, and Philip E. Slater 


(Agree) responses was a manifestation of a 
significant personality syndrome. This “tend- 
ency to agree” correlated positively with items 
that reflected a love of novelty and change, 
high stimulus reactivity, anal expressiveness, 
and a liking for enthusiastic but superficial 
involvement—all extraversive characteristics. 
Most prominent among negative correlates of 
“tendency to agree” was a scale developed 
by Couch and called “psychological inertia,” 
which reflects a disposition to control impul- 
siveness (anal retentiveness), a slowness tO 
change cathexes and a long secondary process 
in mental functioning—all introversive tend- 
encies.* 

This dimension seems highly related to our 
interpretation of Factor II as Introversion— 
Extraversion. A further support of this corre- 
spondence of dimensions is the correlation of 
r= .65, which Couch found between “tend- 
ency to agree” on the 360-item inventory a? 
the tendency to mark True on the MMPI. 
This total true score on the MMPI correlates 
r= —.75 with Welsh’s R scale, a finding 
which lends further credence to our generali- 
zation. , 

If this interpretation of Factor II is valid, 
it should be possible to give a new concep- 
tualization to the vectors which lie midway 
between our orthogonal axes of Factors I and 
II. These four vectors should reflect Normal 
Introversion, Normal Extraversion, Disturbed 


3 It is rather interesting to find a detailed descrip- 
tion of this aspect of introversion-extraversion ut 
Freud, who, however, reserved the term “introver- 
sion” itself to a quite different characteristic which 
was associated with, rather than orthogonal to, neu- 
rosis. The Jungian conception of introversion is more 
closely approximated by what Freud called “adhe- 
siveness of libido” (Freud, 1953, pp. 344-345). He 
refers to patients who “cannot make up their minds 
to detach libidinal cathexes from one object and dis- 
place them to another.” He likens the analyst to & 
sculptor who with these cases works in hard stone, 
while with their antitheses molds soft clay or even, 
he adds despairingly, writes on water, due to the 
ease with which new cathexes are abandoned. In the 
adhesive patients he sees an “exhaustion of the i 
pacity for change and development” and a “psychica 
inertia” quite independent of normal resistance (a 
distinction relevant to our discussion of the repres- 
sion scale). Freud does not attempt to account for 
these types in psychoanalytic terms but attributes 
them to fundamental differences in the rhythm 0 
psychical development. 


E 


+ 


“fe 


Factorial Dimensions of the MMPI 


Table 4 
Theoretical Matrix for Pooling Square Technique 
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cen and Disturbed Extraversion. But 

7 z examining the factor space in detail, it 

i essary to discuss briefly the techniques 
e used in generalizing our analysis. 


The ‘ 
he Construction of Factorial Tests 


Pe first wished to obtain reliable measures 
kn e MMPI factorial dimensions, UsinS the 
oe of the factor space gained from the 
sı or analysis. For this purpose the pooling 
“igs technique (Thompson, 1949) is per 
aps the simplest and most useful. It allows 
One to determine the hypothetical loadings, 
On each factor, of the sum of any group of 
Ep included in the propose 

a matrix is constructed as shown 
with A = the theoretical communality 0 
factor in question (1.00), B = the factor load- 
ings of the several variables which are can i- 
dates for inclusion as measures of the factor, 
and C = the intercorrelations of these vari- 
ables (obtained from the original correlation 
matrix), then the correlation of this set ° 
Variables (equivalent to an average of stand- 
> scores) * with the theoretically de 
actor (denoted Afi) is 


ia ee 
a = 
VAC 

4 A 
y: When the variable domain involves heterogencovs 
Varanas, as in the present study, it is necessary 2 
ae all component scale scores tO standard scores 

ior to computation of the new factor test score- 


but in this case A = 1.0, thus 


Lai 
NÈT 


An = 


In this way it is possible to assess the load- 
ing of the entire scale on each of the dimen- 
sions of the factor matrix. The selection of 
variables to be included in the scale attempts 
to maximize the communality of the new test, 
and minimize the saturation on other fac- 
tors by equalizing their positive and negative 
loadings. 


The Factor Fusion Approach 


We have long been of the opinion that if 
factor analysis is ‘to make significant con- 
tributions to personality theory it is impera- 
tive to attempt to conceptualize the entire 
variable domain. For this reason, it is our 
practice to define and measure those vectors 
lying midway between the primary reference 
ords, once having established 


axes. In other W 
the primary reference axes by the usual sim- 


ple structure criterion, we rotate the axes 45 
degrees and repeat the procedure of defining 
the factors and constructing factor tests by 
the pooling square technique. 

We have adopted the practice of calling 
these new factors “factor fusions,” inasmuch 
as they may be conceived as combinations of 
the primary reference axes. To do so is not 
to overlook the fact that the decision as to 
which factors are to be considered the pri- 
mary reference axes is a completely arbitrary 
one. It is our view that ideally nothing other 
than theoretical relevance should fix the pri- 
mary axes in any particular position. 

Although this approach is something of a 
departure from usual factor analytic pro- 
cedure, the view that one should be able to 
measure any vector within the factor space 
was recently stated by Kuder (1954) and re- 
flects a viewpoint that is becoming more wide- 
spread. The work of Leary (1957) and his 
associates, for example, is based upon a two- 
dimensional system of interpersonal behavior 
in which 16 equidistant vectors are measured 
independently. Our practice of defining and 
measuring those vectors lying midway be- 
tween the primary axes is a first step in this 
direction. We feel that it has two advantages 


232 Gene G. Kassebaum, Arthur S. Couch, and Philip E. Slater 


4 
not realized in either standard orthogonal or 
oblique solutions. 
= The first advantage is conceptual clarity. 
A better understanding of the nature of the 
fixed position factors is produced when they 
are examined in relation to other dimensions 
in the factor space. It is often particularly 
profitable to test the validity of the concep- 
tualization of the original factors by obtain- 
ing predictions (made on the basis of these 
conceptualizations alone) of the nature of the 
factor fusions before the rotation is made. 
The second advantage is the increased prob- 
ability of a continuity of studies. The arbi- 
trary placing of axes according to the simple 
structure criterion maximizes apparent di- 
versity of findings if fusion positions are not 
also interpreted. This diversity is often due 
to such accidents as the selection of variables 
to be included in the analysis. For example, 
if Investigator A includes more tests which 
lie on Axes I and II, while Investigator B in- 
cludes more tests which lie on Axes I’ and IT’, 
their simple structure solutions will lie 45° 
from one another. An impression of great dis- 
parity will be created when in reality an al- 
most perfect replication has been achieved. 


The Fusion Factors 4 n 


The fusion factor whose positive end lies 
between the positive ends of Factors I and II 
we will call Fusion Factor A. As can be in- 
ferred from Table 3, its highest and purest 
loadings are on Si, D, and Fm (Feminine 
Masochism) on the positive end, and Sp (So- 
cial Presence), Sy (Sociability), and St (So- 
cial Status) on the negative end. We have 
tentatively labelled this factor Social With- 
drawal vs. Social Participation. 

The fusion factor whose positive end lies 
between the positive end of Factor I and the 
negative end of Factor II we will call Fusion 
Factor B. Its highest and purest loadings are 
on Im (Impulsivity) and Ma on the positive 
end, and Re (Social Responsibility) and Ac 
(Achievement via conformance) on the nega- 
tive. Originality (O-1) and Ai (Achievement 
via independence) also lie along the negative 
end of this axis but have more modest load- 
ings. We have tentatively labelled this fusion 
factor Impulsivity vs. Intellectual Control. 

Table 5 presents the pooling square esti- 
mated loadings of the constructed tests for 
Factors I and II and Fusion Factors A and 


Table 5 
Estimated Loadings on MMPI Factor Tests and Fusion Factor Tests 


I IL ur h? 

Factor I Ego-Weakness vs. Ego-Strength .99 .08 —.02 98 

Psychasthenic, Schizophrenic, Anxiety, Dependency 

and Psychopathic Scales, (—) Leadership, (—) Toler- 

ance, (—) Ego-Strength, (—) K-Suppressor, and (—) 

Intellectual Efficiency Scales 
Factor II Introversion vs. Extraversion 04 90 —.04 81 

Repression-Denial, Social Responsibility, Social Intro- 

version Scales, (—) Hypomania, (—) Sociability Scales 
Fusion A R $ $ 
Factor A Social Withdrawal vs. Social Participation .94 13 02 91 
(I+II+)* Social Introversion, Depression, Feminine Masochism 

Scales, (—) Sociability, (—) Social Presence, (—) 

Social Status Scales 
Fusion 
Factor B impulsivity vs. Intellectual Control .09 91 —.10 85 
(I+IT—) Impulsivity, Hypomania Scales, (—) Social Responsi- 


bility, (—) Achievement via Conformance Scales 
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Fig. 1, Factors and factor fusions. 


B, along with the scales of which the tests 
are composed. 


Summary of Factor Interpretations 


In order that the factors and factor fusions 
may be visualized in relation to one another, 
a graphical presentation of the four axes is 
shown in Fig. 1, with the labels we have 
chosen. This should help to clarify the sum- 
mary description of the four dimensions which 
follow, 

Factor I: A dimension of ego-weakness vs. 
ego-strength, Maladjustment, “general neu- 
toticism,” anxiety, dependency, and a tend- 
ency toward personality and behavior disor- 
ders, as opposed to healthy nonanxious per- 


- sonality, absence of disorders, and a tendency 


toward leadership and intellectual ability. 

Factor II: A dimension of introversion vs. 
cctraversion, High “psychological inertia” or 
adhesiveness of libido” as opposed to ease 
and lability of object cathexis. Cautious, con- 
trolled, inhibited, intellectual, skeptical, intra- 
Punitive personality vs. adventurous, impul- 
sive, expressive, gregarious, naive, extrapuni- 
tive Personality. In psychoanalytic terms this 
™Mension expresses the superego-id balance 
within the personality, while Factor exe 
Presses the strength of the ego. : 

“usion Factor A: A dimension of social 
withdrawal vs. social participation. Shy, se- 
octave Submissive, guilty, depressed, pe 
ci Istic personality, as opposed to poised, Si J 
‘able, dominant, confident, and spontaneous 
Personality, 


J 
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f Fusion Factor B: A dimension of impulsiv- 
ity vs. intellectual control. Impulsive, manic, 
excitable, erratic, uncontrolled, delinquent per- 
sonality as opposed to responsible, controlled, 
intellectual, stable, original, intraceptive, in- 
sightful personality. 

It might be added that in psychoanalytic 
terms, Factor A seems to suggest the ego 
overwhelmed by a harsh superego (Depres- 
sion), while Fusion Factor B suggests the 
ego overwhelmed by impulses from the id 
(Mania). Note, too, that Social Withdrawal 
and Intellectual Control, the two vectors ad- 
jacent to Introversion, provide a representa- 
tion of the distinction often drawn between 
“social introversion” and “thinking introver- 
sion.” 

It should be noted at this point that these 
interpretations of the factors are based on a 
logical-inductive approach, which assumes the 
empirical validity of the MMPI scales. Our 
conceptions of the major dimensions are at 
esent theoretical hypotheses, based on the 
inductive implications of the factor pattern. 
It would require further research involving 
psychological studies of subjects high, mid- 
dle, and low on the factor scales to give more 
direct empirical support to these conclusions. 
Furthermore, the use of these major dimen- 
sional scales of the MMPI in clinical practice 
would add considerably to a clarification of 
the underlying dispositions that are being 


measured. 


pr 


Comparisons with Other Studies 


As suggested above, the strongest support 
for our factor interpretations comes from 
Eysenck (1953), who found repeatedly in his 
review of factorial studies of personality that 
the bulk of the common factor variance in 
these studies was accounted for by a general 
factor of neuroticism or ego-weakness, and 
a bipolar factor of introversion—extraversion. 
That this same structure should also emerge 
from a study of the MMPI is encouraging to 
those hopeful of isolating stable personality 
dimensions of widespread applicability. Stud- 
ies of the Guilford inventory by Lovell (1945) 
and North (1949) seem particularly similar 
to ours. 

We feel, however, that the isolation of our 


fusion dimensions adds most significantly to 
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the struggle for factorial continuity. Some of 
the studies cited by Eysenck, particularly 
those of Goldman-Eisler (1951; Eysenck, 
1953, pp. 123-126), seem to fit poorly into 
his two-dimensional framework. Although Ey- 
senck sees a resemblance between Goldman’s 
second factor of oral optimism—oral pessimism 
and extraversion-introversion, Goldman’s first 
factor, defined by impulsion vs. deliberation, 
is hardly one of neuroticism or ego-weakness. 
It now becomes clear, however, that Gold- 
man’s factors very closely approximate our 
fusion factors, while her 45° vectors, though 
quite poorly defined, seem to approach our 
Factors I and II. Impulsion vs. deliberation 
corresponds to our Impulsivity vs. Intellec- 
tual Control, while oral pessimism (endo- 
cathexis, aloofness) vs. oral optimism (exo- 
cathexis, nurturance) corresponds to our 
Social Withdrawal vs. Social Participation. 
Eysenck (1953), for example, defines oral 
optimism as “distinguished by . . . gener- 
osity, bright and sociable social conduct, ac- 
cessibility to new ideas and ambition accom- 
panied by sanguine expectation,” and oral 
pessimism in terms of “moods of depression 
and attitudes of withdrawal” (p. 124). 

We should like to suggest the hypothesis 
that an orthogonal solution of a factor analy- 
sis of any personality inventory or battery of 
trait ratings of sufficient size and complexity, 
and drawn from a normal population, will 
Produce a structure in which all eight 45° 
vectors of the two largest factors will be es- 
Sentially similar to those we have identified. 
We feel that deviations from this structure 
are due only to peculiarities of samples, in- 
sufficiently “covered” domains, and the use 
of oblique solutions. 

This hypothesis derives considerable sup- 
port from an examination of the factorial 
studies of the MMPI. While a full review of 
this literature is not appropriate here, a brief 
survey should serve to illustrate the point that 
the more MMPI scales included in a factorial 
study of that instrument, the more closely the 
results approximate ours. 

All of these studies have found a frst fac- 
tor similar to ours, but in the early studies, 
in which only the clinical scales were included, 
no factor emerged which could conceivably be 
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conceptualized as introversion-extraversion. 
Hints were present only in the form of a 
small factor loaded on Ma, D, or both. The 
studies of Cook and Wherry (1950), and of 
Wheeler, Little, and Lehner (1951) fall into 
this category. 

Tyler’s study (1951), which included Pr, 
Re, Do, St, and Ac in addition to the clinical 
scales, falls into an intermediate category. 
His Factor III (Social Aggression and Fric- 
tion), with positive loadings on Ma, Pd, and 
Pa, and negative loadings on Si and Re, re- 
sembles a mirror image of our Factor II. 

Studies by Welsh and his associates (1956, 
pp. 264-281) also fall into this category. 
After a careful examination of previous fac- 
torial studies, Welsh constructed a number of 
special scales, including a set of revised clini- 
cal scales from which all item overlap had 
been eliminated. In addition, the A scale was 
constructed from items which differentiated 
extreme scorers on a scale of general malad- 
justment (Gm). The R scale was developed 
in a similar manner from a special “prime” 
(no item overlap) D scale. Welsh then factor 
analyzed this group of special scales and ex- 
tracted three factors. No rotations were car- 
ried out. The first factor was loaded .99 on 
A and the second .88 on R. 

Our analysis essentially replicates Welsh’s 
findings. A is loaded .88 on Factor I, while 
R is loaded .69 on Factor II. Both the high 
loadings and the orthogonality of his scales 
are reflected in our analysis.’ 

The analysis which most clearly supports 
our findings is an unpublished study by 
Jerome Fisher (1957).° Fisher’s variables in- 
clude 23 MMPI scales and four additional 
measures. Of the five factors extracted, the 
second and fourth are heavily influenced by 
the non-MMPI variables. The first factor 
seems to reflect the familiar dimension of 


5 It might also be noted that if Welsh’s second and 
third factors are rotated, his third factor also bears 
a remarkable resemblance to ours. The few differ- 
ences existing between these two analyses are un- 
doubtedly due in large part to his use of “prime” 
scales, 

° We are grateful to 
tunity to inspect his 
report entitled, 
of physical dise: 


Jerome Fisher for the oppor- 
analysis in a dittoed progress 
“An empirical study of the relation 
ase to body-object cathexis.” 
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general ego-weakness. The third factor is the 
most interesting from our viewpoint, with 
high positive loadings on Ma, and high nega- 
tive loadings on R, Si, and D. Other variables 
which-helped to define our Factor II, such as 
Re, Sy, Sp, and Im, were not included in his 
analysis, but the correspondence is nonethe- 
less striking. 

That previous investigators have never con- 
ceptualized MMPI factors in terms of intro- 
version—extraversion seems to be due in large 
part to their heavy dependence upon the 
original 13 scales. Another important con- 
sideration, however, is the fact that MMPI 
researchers have had little success In con- 
structing scales unsaturated with Factor i 
due presumably to the strong pathological 
emphasis of the instrument. Many research- 
ers, moreover, have concentrated on the se- 
clusive more than the intellectual and reflec, 
tive aspects of introversion, and least of all 
on the central tendency of this complex trait. 

It should be noted that none of the ua 
regarding typical pathological expressions 0 
introversion and extraversion are borne out in 
this analysis. We do not find F: actor Il sope“ 
rating the cycloid from the schizoid, nor r 
hysteric from the psychasthenic. If we ch - 
bine Ma and D by the pooling square met. z 
we find all four relevant measures (M : $ à 
Sc, Pt, Hy) cluster obstinately around t con 
point of this dimension. In the absene = 
ever, of either theoretical agreement or S 
perimental confirmation in the past rega a 
these relationships (Eysenck, jot see 
we feel justified in leaving the questio 
for the moment. 

Summary 


A factor analysis of 32 scales fae hae 
MMPI produced three factors, the e 
of which were called Ego-W eakness pat go- 
Strength, and Introversion-Extrav i tj a . 
spectively. In discussing conceptua 


the 

the second factor it aR sen pat 
Wer í e expr i 

oe eee Te agree with all items 


by a general tendency to 
ee es gly that continuity in 
8 


We have argued strong k 
factor analytic research is completely depe 


A rement of 
ent upon interpretation and measu 
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the entire factor space, and a simple pro- 
cedure for achieving this goal was outlined 
and applied to this study. A method of con- 
structing reliable and factorially “pure” fac- 
tor tests was also described. 

A brief review of other factorial studies of 
personality revealed greater continuity than 
is usually apparent when interpretation of 
vectors other than the primary reference axes 
is neglected, and adherence to an arbitrary 
simple structure criterion is maintained. It 
was hypothesized that the two-dimensional 
structure which emerged in our analysis will 
be found in any large-scale factorial study of 
the personality domain, provided the study is 
of sufficient scope and the entire factor space 
interpreted. 


Received April 29, 1958. 
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Termination has rarely been studied as a 
dynamically important and necessary event in 
psychotherapy or counseling. The vagueness 
with which most texts on psychotherapeutic 
techniques deal with it attests to the unstable 
nature of the conceptualization behind acts of 
therapeutic termination. The problem seems 
to center around appropriate criteria for ter- 
minating clients. y 

The literature on the subject of termina- 
tion splits itself into three major classes: the 
first tends to deal in generalities with the 
necessary conditions for successful termina- 
tion. For example: Weigert (1952) states 
that “the resolution of the countertransfer- 
ence is presented as a means of determing 
the approaching termination of psychoanaly- 
sis. . . .” Masserman (1955) concludes that 
“the completion of psychotherapy » > « is x 
dicated not by what the patient says but y 
(a) how he feels, (b) how well he se fee 
and (c) what his prospects for continue F he 
provement without further therapy are r 
sonably judged to be.” 

A second group of Pal 
deals largely with empiric 
tionships between length of t 
improvement. Notable among F 
studies reported by Rogers an 
Seeman (Chap. ) 

d in favor of pigne 
» Si 
success ratings for aes 
twenty interviews). 1 that 
termination in the edi ai 

time was the client’s de 
therapy. Myers and Auld (1955) gaa 
this finding, reporting that there is g ‘ap 
frequency of success ratings by t eee ate 
patients in treatment for “twenty intervi A 
or more... ,” than among short-term pa 
tients. As in many studies of this type, the 


pers on termination 
al data on the rela- 
reatment and 
these are the 
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category “twenty or more” leaves the upper 
limit much more poorly defined than the 
lower one. 

A third group of studies attempts descrip- 
tively to relate other variables to length of 
time in therapy. Middle-class patients tend to 
stay in therapy significantly longer than the 
lower-class patients (Imber, Nash, & Stone, 
1955; Winder & Hersko, 1955). Therapists 
tend to keep patients in treatment longer when 
they initially perceive them to be healthier 
(Conrad, 1954). Inexperienced therapists tend 
to have greater difficulties terminating pa- 
tients than experienced therapists (Auld & 
Myers, 1954; Myers & Auld, 1955; Myers & 
Schaffer, 1954; Schaffer & Myers, 1954). 

In several studies (Kotkov & Meadow, 1953; 
Rogers, Knauss, & Hammond, 1951; Schaffer 
et al., 1954), duration of therapy is consid- 
ered the criterion for success, on the assump- 
tion that successful therapy requires long pe- 
riods of intensive work. Again, the upper 
limits of this relationship remain unconsid- 
ered, so that the patient in interminable treat- 
ment is left in limbo. 

The most notable early attempt to deal 
with termination in a systematic, definitive 
fashion was made by Otto Rank (1929), who 
postulated the entire therapeutic process to 
be a “preparation for separation,” a synthetic 
re-enactment of the original experience of 
birth trauma, or physical separation from the 
mother. Characteristically, the point of ter- 
mination was set early in treatment, and the 
patient gradually worked toward the experi- 
ence of successful termination. 

Freud (1953) himself experimented with 
this approach in the attempt to guard against 
what he described as “interminable analyses.” 
He concluded that “the measure is effective, 
provided that one hits the right time at which 
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F 
to employ it.” He added, however, that “. . . 
while the force of the threat will have the ef- 
fect of bringing part of the material to light, 
another part will be held back and become 
buried, as it were, and will be lost to our 
therapeutic efforts.” 

The language of therapy today has pro- 
vided a convenient rationale for seemingly 
interminable therapy cases. The term “main- 
tenance therapy” implies that, for selected 
patients, the ability to function without the 
continued support of their therapists is con- 
stricted. This concept stems, in part, from 
Federn (1953) and other “ego-psychologists” 
who hypothesized that in seriously ill (schizo- 
phrenic) patients, there exists a genetically 
weak ego with highly vulnerable ego-bounda- 
ries, who cannot function without the aid of 
another supportive ego—such as that of rela- 
tive, therapist, or nurse. 

The questions remain: Is indefinitely pro- 
tracted (interminable) therapy the treatment 
of choice in any cases? Is it purposive, effi- 
cient, therapeutic? Or is it the result of poorly 
conceived therapeutic goals based, in part, on 
unsubstantiated theory? 

This paper presents the results of a small 
investigation into the circumstances surround- 
ing protracted (and seemingly interminable) 
psychotherapy with four groups of patients 
in one outpatient setting. 


Procedure and Results 


This study was designed to assess the re- 
sults of brief, and prolonged, periods of psy- 
chotherapy in an outpatient setting. The total 
sample consisted of 66 patients, subdivided 
into the following four groups: 


Group A: 15 white, male veterans currently being 
seen monthly by practitioners outside the Veterans 
Administration on fee basis. Mean length of time in 
therapy is 7.9 years, ranging from 3 years 6 months 
to 10 years. 

Group B: 18 white, male veterans currently being 
seen by therapists on the staff of the VA Mental 
Hygiene Clinic. They also are being seen on an av- 
erage of once monthly. Mean length of time in ther- 
apy is 5.3 years, ranging from 2 years 8 months, to 
7 years, 11 months. 

Group C: 15 white, male veterans currently being 
seen by therapists on the staff of the VA Mental 
Hygiene Clinic. They are being seen on the average 
of once every 10 days, with a mean duration of 14 


months, 
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Group D: 18 white, male veterans who have had 
therapy terminated, for various reasons, in the Men- 
tal Hygiene Clinic. They were seen on the average of 
once every ten days. Mean duration was 7.1 months. 


For the purpose of this study, the first two 
groups have been labeled “long-term” pa- 
tients, while the last two groups have been 
called “short-term.” Latent in Group C are 
patients who may be later redefined as “long- 
term.” The first three groups are still in treat- 
ment and were tested, for the purpose of this 
study, while in therapy. The last group has 
terminated treatment. 

For Groups A, B, and C, psychological test- 
ing was obtained while they were in treat- 
ment. The test battery consisted of a brief 
intelligence scale (Shipley-Hartford), the 
Minnesota Multiphasic Personality Inventory 
with Subtle-Obvious keys (Wiener, 1948), 
and Navran’s Dependency Scale (1954), all 
scored, in addition to the traditional four va- 
lidity scales and nine clinical scales with Si 
(Social introversion). 

For Groups B and C, these data were also 
available prior to the time the veterans en- 
tered treatment. For Group D, the data were 
available only prior to therapy. 

Table 1 represents the comparison of the 
groups on age, intelligence, education, and 
gross diagnostic category. Groups C and D 
are significantly younger than Groups A and 
B. However, there are no significant differ- 
ences among the groups on education or me- 
telligence, nor do they appear to be signifi- 
cantly different diagnostically. 

On the MMPI, there were no significant 
differences between Groups A and B (long- 
term fee basis and clinic veterans) while in 
therapy, despite the fact that the former 
group had been in treatment a significantly 
longer period of time. The only scale which 
reflected a difference of statistical significance 
was Si (T: 2.08, p < .05), on which the fee- 
basis group (Group A) was the higher. If one 
does not attribute this significance to sam- 
pling error, the interpretation would be that 
the fee-basis group is more socially withdrawn 
than the group being treated in the clinic. In 
all other respects, Groups A and B are similar 
and may be thought of as constituting a 
single group of “interminable” patients. , 

In comparing Group B’s pretherapy testing, 
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Table 1 


Background of Patients Studied 


Gross Diagnoses 


Intellig.* Education Pers. 
Age (Raw Score) (Years) Neuroses Disorder Psychoses 
Group A 40.40 55.07 11.47 12 0 3 
Group B 44.89 53.17 10.94 14 0 4 
Group C 34.87 53.60 12.13 13 1 1 
Group D 31.56 51.18 11.11 15 2 1 


` Shipley-Hartford. 


with testing after 5.3 years, there appeared 
to be general improvement (not statistically 
significant, however, and not inconsistent with 
the general “regression toward the mean” fre- 
quently observed in retesting with the MMPI). 
There was only one statistically significant 
reduction in scale mean over the period of 
therapy, That was on Hy Obvious (T: 2.07, 
$ < .05), which, since it is an isolated find- 
ing and inconsistent with other data, might 
well have been the result of sampling error. 
Group C (short-term, still in therapy) W2® 
also tested before and during treatment. After 
an average 14 months in therapy, there was 
no significant alteration on the MMPI scales. 
There was a tendency toward general minimal 
improvement, insignificant, however, with a 
significant drop in D Obvious (T: 2.33, P< 
05) which, again, can be attributed to sam- 
Pling error. ; ; 
On pretesting, there were no significant dif- 
ferences between short-term terminated veter- 
ans (Group D) and short-term nonterminated 
(Group C), on any MMPI scales except Hy 
Obvious (T: 2.39, p < 02). When compared 
with long-term clinic patients (Group B); os 
terminated patients (Group D) also appeare 
hot to be significantly different on any scales 
except Mf (T: 2.73, p 05): with the termi- 
nated patients higher. 
Long-term and shor 
(Groups B and C) were also compared on 
Pretesting. Significant differences were found 
on Hs, Hy, and Hy-Obvious, with long-term 
Patients having the higher scores. This sug- 
Bests a greater concern with physical and 
health problems among the long-term patients 
which might, in part, be accounted for by the 


t-term clinic patients 


differences in ages between the two groups. 
Tests of variance between all groups also 
yielded generally negative results. 

Since the data suggested that no greater 
benefits were reflected in the group several 
years in psychotherapy, over those several 
months in treatment—and since the depend- 
ency of the patient (as measured by the 
Navran De scale) appeared in no measure 
related to the length of time spent in therapy 
—other possible explanatory variables needed 
to be explored. 

To examine the influence of therapists on 
the duration of therapy, two samples of thera- 
pists and their patients were studied to de- 
termine the distribution of long-term patients 
among therapists. Tables 2 and 3 summarize 
this data. The first sample consisted of seven 
therapists and 72 patients, following therapy 
termination. i 

Using the data from Table 2, 19% of the 
patient population spent over 20 sessions in 


Table 2 


Relationship Between Therapist and 
Number of Interviews 


Mn. No. 
Total Sessions Patients ER 
Thera- No. of in over 20 over 20 
pist Patients Therapy Sessions Sessions 
A 15 10.80 2 3 
i 3 
B 13 40.46 7 Be 
c 10 5.20 0 00% 
D 18 8.89 1 06% 
E 5 19.20 1 20% 
F 5 17.40 2 40% 
G 6 7.83 1 17% 
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Table 3 
Relationship Between Therapist and Length of Therapy 
Total Mn. 
No. of Mos. in No. over % over No. over % over 
Therapist Patients Therapy 2 Yrs. 2 Yrs. 3 Yrs 3 Yrs 
A 5 25.60 1 20% 1 20% 
B 3 29.67 2 67% 2 67% 
c 20 12.30 2 10% 1 05% 
D 13 23.61 6 46% 2 15% 
E 12 17.42 1 08% 1 08% 
F 16 16.69 6 38% 1 06% 
G 30 14.90 2 07% 1 03% 
H 31 29.61 17 55% 12 39% 
psychotherapy. Using this percentage as a with a total of 2,394 therapy months and a 


base line, three therapists had more of their 
patients in therapy over 20 sessions, and four 
therapists with fewer. A chi-square test of 
the number of long-term patients of 3 long- 
term therapists vs. four short-term therapists 
yielded a chi-square ratio of 9.69, significant 
at the .01 level of confidence with one degree 
of freedom. 

A second sample consisted of eight thera- 
pists and 130 patients, all in treatment at the 
time of this study. This sample was somewhat 
more highly controlled: Only those patients 
who were being seen by full-time staff mem- 
bers with roughly equivalent training and ex- 
perience were selected. Of the therapists, three 
were psychiatrists, two were psychologists, 
and three were social workers. 

Table 3 summarizes the data, including the 
number of patients, both the mean and me- 
dian months in therapy (rather than sessions 
this time), the percentages of patients over 
two years, and the percentages of patients 
over three years. 

As can be seen from the table, there is wide 
variation in the percentages of patients seen 
for two years or longer. There does not ap- 
pear to be a concentration of “long-term” pa- 
tients with any particular discipline. In the 
first group of therapists, all three “long term- 
ers” were psychologists; in the second group, 
one was a psychiatrist, one a social worker, 
and two psychologists. 

Dropping out therapists A and B (because 
of the low Ns), the total number of patients 
seen by the remaining six therapists is 122, 


mean of 19.6 months in therapy per patient. 
Total percentage of patients in treatment over 
two years is 27.9. Total percentage of patients 
in therapy over three years is 13.1. Using the 
latter again, as a rough cutting point, two 
therapists (D and H) have percentages of 
long-term patients greater than this. Thera- 
pists D and H account for 78% of the long- 
term patients in therapy. Therapist H alone 
accounts for 67% of all long-term patients 
currently being seen in the Mental Hygiene 
Clinic by full-time staff members. 

A chi square between numbers of patients 
treated by the two groups of therapists yields 
a ratio of 15.9, significant at the .01 level of 
confidence, with one degree of freedom. In 
the second sample (the data were not readily 
available for the first sample), the propor- 
tions of diagnostic classes falling to each 
therapist do not appear to be significantly 
different. The percentage of diagnosed psy- 
chotics treated by the entire group of thera- 
pists was 27.7 and for the long-term thera- 
pists, 28.5. All other members of the patient 
group carried psychoneurotic diagnoses. 


Discussion 


The data presented suggest that, insofar as 
the MMPI and its auxiliary scales are able to 
assess them, long-term therapy shows few, if 
any, advantages over short-term therapy. : 

Further, the data suggest that the majority 
of long-term patients can be accounted for by 
a minority of the therapists, making it highly 
desirable to determine whether: 
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1. Certain therapists are, purposely or otherwise, 
assigned chronic, potentially interminable patients be 
cause of their “special talents” in dealing with them; 
or 


2. The therapist, in his relationship with the pa- 
tient, in some way encourages “interminability be- 
Cause of difficulties in formulating goals, or in re- 
linquishing relationships. 


The possibility remains that there may be 
something inherently (and untestably) differ- 
ent in patients who become interminable in 
Psychotherapy, and something that transcends 
rough diagnostic categories and other dimen- 
sions of behavior that are generally ae 
However, it is also reasonable to paR OPT 
other half of the therapeutic řelationsDip aa 
has been done previously (Auld et al., a i 
Myers et al., 1955; Myers et al., 1954; >: oa 
fer et al., 1954) to a limited degree, to í A 
termine not only how experienced Hea 
differ from inexperienced therapists 1n re J 
tion to termination problems, bot Soe ee 
Sonality types or needs within the terap A 
themselves affect therapy. Further AgxyennE S 
tion is needed of “interminability Ta that 
in therapists, since our data one ker 
eclectic long-term therapy may be 
economical nor particularly on ted who 

When four judges roughly pre A would 
the “long-term” therapists in the 2 79 with 
be, their pooled rankings corrente dimen- 
the criterion, suggesting a predicta RRE 
sion in the area of “dependen na thera- 
The judges characterized the long-ter rily de- 
Pists in these ways: therapist prima be sus- 
sires to “help,” and this feeling Get T 
tained indefinitely; tends to Pa in 
tionship; tends to aim for marke d with in- 
very sick patients; desires to ae reciated 
tensive therapy; and needs to fee se ED 
and effective (as a person and as 4 he judges 

One of the comments made by : ° dealing 
Suggested that the therapists be intermi- 
with chronic patients who require 
nable support. i 

be yaaa of this study point ars 
need for careful re-examination ot AA 
8oals. Even in the event that ey therapists 
of interminable patients with a few ts of par- 
can be accounted for by See an of in- 
ticularly chronic patients,” the as choice 
terminable treatment as a treatment 0 tion 
for these patients needs further inspection. 


Our tentative conclusion, that therapists them- 
selves may be responsible for the intermi- 
nability of treatment, places even greater re- 
sponsibilities on the professions who prepare 
psychotherapists for treating chronic patients. 
It seems to us likely that psychotherapeutic 
practice today contains self-defeating concepts 
which may be not only hampering to the suc- 
cess of treatment, but potentially harmful to 
its clients. : 
Summary 


1. Sixty-six patients were divided into four 
groups, according to the amount of time spent 
in therapy. Two groups were described as 
“Jong-term,” and two as “short-term.” 

2. Follow-up psychometric findings revealed 
insignificant differences among the groups ini- 
tially similar, suggesting that length of time 
in therapy does not correlate with improve- 
ment. 

3. Two samples of therapists indicated that 
the great majority of long-term patients were 
being seen by a small minority of the thera- 
pists. A likely reason appears to be failure on 
the part of “long-term” therapists to ade- 
quately formulate therapy goals, and to im- 
personalize the therapeutic relationship. 
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The relationship between anxiety and the 
process whereby a psychotherapy patient be- 
comes aware of and eventually verbalizes re- 
pressed material is a matter of both meor 
cal and practical interest to the therapist. T 
present status of psychological theory w1 1 
respect to this problem allows for — 
different and contradictory predictions abou 
this relationship. 

It is a reasonable to — = 
when certain material is repressed, A wih 
pressor experiences anxiety associa e oon 
this material to the extent that the nao 
is incomplete. That is, with complete oe at 
sion, internal anxiety-producing Bore dose 
Present and, accordingly, an anxie 7 “_ 
is nof made. As repression Lest oe cues 
plete (more and more anxiety-Pro apenas 
appear), more and stronger anxiety Te 
are made. From this point on, it 1 dictions 
to pose reasonable but alternative pre nd the 
as to the relationship between ee an 

rocess of “lifting” a repression. — 
j On the one hand qe ner EN ma 
some psychoanalytic writings that fe At fhe 
ment of full realization (“insight”) i nxiety 
repressed material results in relief or a 


reduction. k spect that 
ne might expec 
On the other hand, © d clarity of the anx- 


the increased number and, ; and 
iety-producing cues, associated Te a 
less complete repression, leads to = Aa lete 
anxiety as the individual approac a meet 
awareness of the formerly repressed ! 


while J. E- Gordon 
eat at the Univer- 
USP.HS. grant. 


1 This research was perfor! 
Was Resident Lecturer in Psy 
sity of Wisconsin, supported by a 


Further, overt verbalization of the repressed 
material should involve even more fully con- 
stituted anxiety-producing cues and, accord- 
ingly, greater anxiety than is present during 
awareness without overt verbalization. 

To complicate the problem further, one 
must introduce the possibility of extinction of 
the learned association between cue and anx- 
iety response. Such extinction is likely to be- 
gin shortly after awareness or overt verbali- 
zation has occurred in psychotherapy. 

In view of the above considerations it does 
not seem appropriate to state directional hy- 
potheses in the present study, which was de- 
signed to explore empirically the relationship 
between anxiety and the “lifting” of a repres- 
sion, as the threatening material moves from 
a state of repression through awareness with- 
out verbalization (suppression) to overt ver- 
balization. 

Research which might clarify this relation- 
ship has been made difficult by the nature of 
repression. An experimenter cannot know what 
is repressed until it is no longer repressed, at 
which time it is too late to measure anxiety 
associated with it. However, a set of pro- 
cedures used in an earlier study (Gordon, 
1957) has been modified to make possible 
measurement of anxiety in a situation in 
which repression and suppression of known 
content is experimentally induced. Thus meas- 
urement of anxiety during repression, suppres- 
sion, and verbalization of experimenter-con- 
trolled material is possible. 

A state of repression is assumed to exist 
when a person fails to produce either overt or 
covert cues (usually verbal) to which anxiety 
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responses have been attached, where the pro- 
duction of such cues is appropriate. For the 
purposes of this research, posthypnotic in- 
structions were used for inducing this condi- 
tion. Posthypnotic amnesia was created by 
the instruction to “not think about” a par- 
ticular area of experience. The area of experi- 
ence selected was that of conflict with one or 
both parents. It was assumed that anxiety is 
usually associated with such experiences, so 
that the words used to symbolize such experi- 
ence also serve as cues for anxiety.” 

Suppression is defined as an awareness of 
an area of experience together with the mo- 
tivation to not verbalize about it overtly. The 
experimental manipulations involved hypnotic 
instructions that the subject would think 
about and recall her conflicts with her par- 
ents, but would not want to talk about them. 

Verbalization was defined as conversation 
about parents and/or conflicts with parents 
with the interviewer. The experimental ma- 
nipulations involved hypnotic instructions to 
want to talk about conflicts with parents with 
the interviewer. 

Anxiety was defined in terms of galvanic 
skin conductance. Although there is disagree- 
ment about the nature of anxiety and the 
most valid measures of it, there is consider- 
able evidence that skin conductance, which 
reflects changes in sympathetic nervous sys- 
tem activation, is associated with states of 


?One may question these procedures as satisfying 
the definition of Freud’s concept of repression as a 
defensive maneuver. The instructions to “not think 
about,” while omitting specific mention of avoidance 
motivation, however, do presumably produce a phe- 
nomenon in which previously “conscious” material is 
no longer verbalizable (ie., becomes “unconscious”) 
even though this material later becomes available for 
verbalization. Thus we are not dealing with forgetting 
or extinction. The process in the subject by which 
material is for a time rendered unconscious is better 
described by the term “repression” than any other 
term in current usage. As far as defensive motivation 
is concerned, it is assumed that because the conflict 
material used in this study is usually unpleasant to 
most people, then anxiety is assumed to be associated 
with the verbal conflict symbols. There is reason to 
regard such associated anxiety as a drive or motiva- 
tional factor, the reduction of which can reinforce 
the responses which led to the anxiety reduction. In 
this sense, the instructions to “not think about” an 
unpleasant experience are considered to be analogous 
to defensively motivated repression. 
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general emotional arousal or mobilization 

(Schlosberg, 1954). Emotional arousal may 

be a somewhat broader concept than anxiety, 

but lacking precise operational distinction be- 

tween anxiety and this more general concept, 
the skin conductance measure was accepted 
as the operational definition of anxiety in this 
study. 


Procedure 


Subjects. Ss were 12 female undergraduate 
students at the University of Wisconsin. These 
Ss were selected from a group of 20 females 
who had already been trained and screened 
for hypnotic susceptibility, who agreed to 
serve in this research. The group of 20 from 
which they came was screened from an initial 
group of 44 females who volunteered for “an 
experiment on hypnosis.” Training and screen- 
ing procedures consisted of three successive 
hypnotic sessions, in each of which a more 
“difficult” posthypnotic suggestion was given, 
and the response tested. The final criterion 
for selection of Ss was complete posthypnotic 
amnesia by the end of the third training and 
screening session. 

Control. After the third session, appoint- 
ments were made with Ss for a control inter- 
view. Immediately preceding this interview, S 
was told that electrodes would be attached to 
her fingers in order to record “changes in the 
electrical activity” of the skin, and S was re- 
assured that she would experience no electri- 
cal shock. S was then introduced to the inter- 
viewer who attached the electrodes to S seated 
in a chair at the interviewer’s desk. Contro 
interviews consisted of 15-minute nondirec- 
tive interviews conducted by a trained clini- 
cal psychologist. Ss were told that they could 
talk about anything they cared to, that the 
topic of conversation was completely up to 
them. The purpose of this interview was tO 
provide a period of adaptation to the GSR 
device, and to obtain a measure of base level 
conductance against which to compare the 
conductance measure obtained under the ex- 
perimental conditions. d 

At the conclusion of the control interview, 
each S was again seen by the principal in- 
vestigator, who asked her to fill out the Psy- 
chotherapy Reaction Questionnaire, a scale 
developed by Ford (Ashby, Ford, Guerney, 
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& Snyder, 1957) to tap defensive reactions 


and positive or negative attitudes toward the 
therapist. 

Experimental conditions. Two experimental 
groups were formed. The only difference be- 
tween these groups was in the order of the 
experimental conditions. One group, desig- 
nated RVS, was to receive instructions de- 
signed to produce repression, verbalization, 
and suppression in that order. The other 
group, designated RSV, was to be given in- 
structions designed to produce repression, sup- 
pression, and verbalization in that order. 

Following the control interviews, Ss were 
appointed in random order to the two groups 
for the fifth and final sessions. Ss were hyp- 
notized and given the following instructions: 


Now, as you continue to sleep, I want you to re- 
call in your imagination some of the occasions on 
which you have come into conflict with either or 
both of your parents. Think of times when you 
might have had arguments, or when you felt either 
your mother or your father were too strict, or mA 
you might have felt that you were unfairly treate 
or not being understood. Review some of these oe 
casions in your memory. See them in your minds 
eye. You don’t need to tell me about them—just 
think about them yourself. T'Il give you a minute or 
two in which PII be silent to give you a chance $ 
envision yourself in those situations. Feel rat a 
actly the way you felt at those times. Kindi ast 
live those experiences in your imagination now. ie 
think about them for a little while. 


Conflict with parents was selected as e 
area of experience for this research beaa i 
is a fairly universal experience, and thus likely 
to be realistic for each S, and is one which is 
usually attended by anxiety. The procedures 
thus have the advantage over artificially Al 
duced neuroses of permitting some N 
Over a true and meaningful experience in >S 


Past. R z 
Following these instructions, Ss in the RVS 


Broup were instructed as follows: 

Now, when you wake up, all those GE 
You’ve been thinking about will have comple! a T 
Your mind. You won't be thinking of them $ 


They'll be the farthest things from your pema 
the beginning of your interview with Dr. 7 eee 
Click a key three times. Just ignore Fae ihe key 
mean anything. But later on, when he clic ith your 
gain, all these thoughts and experiences Wi + ut 
ather or mother or both, and your feelings ae 

those experiences, will come to mind. You'll begin 
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to think about them again. You can talk about the 
feelings and experiences that are on your mind. 
You'll want to talk them over with Dr. . Later 
on, Dr. will click the key again. When he does, 
it'll occur to you that you shouldn’t really talk to 
him about your experiences and feelings toward your 
parents, and you wont want to talk about them 
anymore, although they will still be on your mind. 


These instructions were then summarized, 
posthypnotic amnesia for the instructions in- 
duced, and S awakened. 

For the RSV group, the instructions were 
substantially the same, except that instruc- 
tions for suppression were given before the 
instructions for verbalization. 

Upon awakening, S was told that she was 
to be interviewed by Dr. , and that 
throughout the course of the 45-minute in- 
terview, she would have electrodes strapped 
to two fingers. S was told that, as in the con- 
trol interview, she could talk about anything 
she cared to. S was then brought to the inter- 
view room, introduced to Dr. , and the 
electrodes attached. The interviews began in 
a standard manner, with the interviewer tell- 
ing S that the interview would be about the 
same as the one she had before and that she 
might start off by telling something about 
herself. From that point on, the interview re- 
mained within the nondirective framework. 
All interviews were tape recorded. At the 
conclusion of the interview, S returned to 
the experimenter who again administered the 
Psychotherapy Reaction Questionnaire, dis- 
abused S of the hypnotic instructions, and 
told her of the purpose of the study. 

The interviewer did not know beforehand 
whether an S was in the RVS or RSV group. 

GSR recording. Skin conductance measures 
were obtained by using an AC circuit de- 
signed by Grant (1946) and dry silver elec- 
trodes bound to the palmar surfaces of two 
fingers of S’s left hand. Continuous ink re- 
cordings of S’s resistance throughout the ses- 
sion were obtained by feeding the output of 
the GSR apparatus into a General Electric 

Photoelectric Recorder. Resistance scores were 
obtained by halving the difference between 
the low and high points in one-minute sec- 
tions of the ink recordings, and adding this 
to the low point within each one-minute in- 
terval. The conductance scores for data analy- 
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Fig. 1. Distribution of references to parents and 
conflict with parents. 


sis were the reciprocals of these resistance 
measures. 
Results 


As a check on the validity of the experi- 
mental procedures, the interview tape record- 
ings were scored in 30-second intervals for the 
presence of reference to parents, and to con- 
flict with parents. Each interval was scored 
plus or minus for the presence or absence of 
such references during that interval. No at- 
tempt was made to score for magnitude of 
references, or to frequency within intervals. 
Figure 1 shows the distribution of plus scores 
for the RVS and RSV groups. It is apparent 
from Fig. 1 that the Ss did follow the hyp- 
notic instructions, as far as verbalizing is con- 
cerned.’ One S in each group failed to follow 
the instructions; neither made any reference 
to parents, with or without conflict, through- 
out the course of her interview. These two Ss 
were therefore dropped from further analysis. 

Figure 2 presents the conductance scores of 
both groups over all conditions.* The abscissa 


3 The lines marking the boundaries of the experi- 
mental conditions are approximate. The interviewer 
varied somewhat in his timing of the signals, so as 
not to interrupt an S in a flow of conversation. The 
interview sections are therefore not strictly compa- 
rable from S to S in terms of length. The boundary 
lines in this figure are drawn at the times when the 
signals were most frequently given. 

4As was noted in connection with Fig. 1, the 
length of the experimental conditions varied some- 
what from S to S. The number of intervals reported 
in this figure and used in the statistical analyses was 
the maximum number of intervals common to all Ss. 
For several Ss, therefore, the last one or two in- 
tervals in some conditions were dropped from the 


analyses. 
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represents number of two-minute intervals 
from the beginning of the particular experi- 
mental condition. As noted above, the GSR 
records were scored in one-minute intervals. 
These data were collapsed into two-minute 
intervals by adding the scores together in 
successive pairs of one-minute intervals. The 
height of the curves therefore represents the 
RVS and RSV means of conductance scores 
(in micromhos) summed over two one-minute 
intervals. 

It may be seen from Fig. 2 that there is a 
general increase in conductance across the en- 
tire time period. The levelling-off of the con- 
ductance, usually interpreted as adaptation, 
which is commonly found in GSR records 
after the first 15 minutes of recording, is not 
present in these data. That the over-all in- 
crease in height is not a function of the par- 
ticular order of the experimental conditions 
is suggested by the data on Suppression and 
Verbalization. The conductance curve for the 
last experimental condition is higher than for 
the next to last, regardless of whether the last 
was Suppression or Verbalization. 

The GSR data were therefore analyzed for 
differences in shape of the conductance curves, 
rather than for differences in mean conduct- 
ance levels. It is thus possible to draw con- 
clusions about the relationship between the 
independent variables and the growth of an%- 
iety, although level of anxiety at any Pat 
ticular point must be ignored. Figure 3 Pre 
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Fig. 2. GSR curves over time. 
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Fig. 3. GSR curves of all Ss combined, by conditions. 
sents the conductance curves of all Ss, com- 
bined by experimental conditions. The units 
are the same as in Fig. 2. 7 
Grant’s (1956) extension of Alexander's 
trend test was applied to these data. For each 
S, a difference was found between her con- 
ductance levels in two-minute intervals of one 
condition and the comparable two-minute se 
tervals in a comparison condition. Thus a s 
of difference curves was generated kor one 
pair of conditions which were to be compared 
with each other. Each difference oe ai 
tested for the significance of its difference 
from a curve of zero slope. This then tells one 
whether there is a difference in the sone: al 
the curves representing the different a ; 
tions to be compared. Tables 2 2 3, an 
report the results of these analyses. F 
oot 1 indicates that under the Repression 


eps increasing at 
condition, Ss’ conductances were incr £ 


Table 1 


i i f Trend of Differences 
a ees on and Control* 


Between Repres: = = 


Mean 
Source df gapar ——— 
Between ind. slopes 8 ms 
Between ind. quadratics 8 28 
etween ind. cubics 8 06 4.77* 
Over-all slope 1 “0 56 
ver-all quadratic 1 12 B 
Over-all cubic 1 
ee 
* f > 
b < 05. nitrol GSR level of one $ 


* Owing to error in recordi 
useless for statistical analy 
ed on 9 Ss, 


Therefore this 


Table 2 


Analysis of Variance of Trend of Differences 
Between Repression and Suppression 


Mean 
Source df Square F 
Between ind. slopes 9 86 
Between ind. quadratics 9 1.13 
Between ind. cubics 9 .06 
Over-all slope 1 67 78 
Over-all quadratic 1 24 21 
Over-all cubic 1 02 33 


a faster rate than they were during the Con- 
trol interviews. It appears that anxiety in- 
creases as S approaches the point of aware- 
ness, and the repression mechanism becomes 
less effective. 

Tables 2 and 3 compare Repression with 
Suppression and Verbalization. The results do 
not reveal any significant differences between 
the conductance curves in Repression and Sup- 
pression. The Repression-Verbalization differ- 


Table 3 


Analysis of Variance of Trend of Differences 
Between Repression and Verbalization 


Mean 
Source df Square F 
Between ind. slopes 9 1.63 
Between ind. quadratics 9 BS) 
Between ind. cubics 9 89 
Over-all slope 1 1.78 1.09 
Over-all quadratic 1 001 — 
Over-all cubic 1 -001 — 
Table 4 
Analysis of Variance of Trend of Differences 
Between Suppression and Verbalization 
Mean 
Source df Square F 
Between ind. slopes 9 1.23 
Between ind. quadratics 9 1.79 
Between ind. cubics 9 AS 
Over-all slope 1 7.20 5.85* 
Over-all quadratic 1 27 — 
Over-all cubic 1 20 1.33 
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ence curve also does not yield a significant 
slope, although there is a tendency for the 
Repression curve to be somewhat steeper 
than the Verbalization curve. 

Table 4 reports the comparison of Suppres- 
sion and Verbalization. The significant differ- 
ence found indicates that conductance meas- 
ures obtained under Suppression increase at a 
greater rate than those obtained during Ver- 
balization. Figure 3 reveals that the Verbali- 
zation slope is almost flat, whereas the Sup- 
pression slope is one of the steeper slopes 
obtained. Thus it is found that anxiety ac- 
cumulates or builds up at a faster rate during 
Suppression than during Verbalization of dis- 
turbing material. 

The differences between the RSV and RVS 
groups in the questionnaire of attitudes to- 
ward the therapist yielded ¢ = 1.64 (p > .05). 
The mean change in the RSV group was 
+3.6, which is in the direction of more 
positive attitudes; the mean change in the 
RVS group was —5, which is in the direction 
of more negative attitudes; oxy = 5.25. Al- 
though the differences are not significant, due 
to the great variability among the Ss, the re- 
sults suggest a tendency for RSV Ss to feel 
more positively toward the therapist than the 
RVS Ss. This suggests that Ss whose most re- 
cent experience has been one in which they 
revealed, rather than hid from the therapist, 
some personally threatening material may feel 
more positively toward the therapist. 


Discussion 


The most striking outcome of this study is 
the finding that there is never a downward 
turn in the absolute measure of anxiety dur- 
ing the 45-minute experimental session. This 
suggests that the lifting of a repression, 
whether it included Suppression or Verbaliza- 
tion, or both, is accompanied by a fairly con- 
sistent rise in anxiety. An absolute reduction 
in anxiety, for whatever reason, does not seem 
to occur during the first 30 minutes or so after 
the S first becomes aware of the repressed ma- 
terial. It is of interest to note that the two 
Ss who failed to comply with the posthypnotic 
instructions by never verbalizing about par- 
ents in any fashion were the only two Ss who 
did not show this over-all increase in conduct- 
ance. One of these Ss had a decreasing con- 


ductance curve, and the curve of the other S 
was about level. Experience with GSR indi- 
cates that this upward trend is not neces- 
sarily characteristic of interviews of compa- 
rable length. This phenomenon thus appears 
to be associated with the effects of the hyp- 
notic instructions. One possible explanation 
of the continuing rise in conductance may be 
that anxiety associated with parental conflict 
accumulates throughout the time that the Ss 
are forced by the hypnotic instructions to 
deal with this aspect of their experience. The 
over-all upward trend does tend to level off 
during Verbalization. One may account for 
this by assuming that extinction of the asso- 
ciation between cue and anxiety response 0C- 
curs when anxiety-producing material is ver- 
balized in an accepting atmosphere. From this 
point of view, we might expect the curve 
eventually to turn downward if sufficiently 
long periods of Verbalization were maintaine 
until the verbal cue-anxiety association is ex- 
tinguished. Perhaps the 15-minute period was 
not sufficient to get a full indication of the 
degree to which extinction could occur dur- 
ing Verbalization. R 

A simpler account of the change in slope 
during Verbalization might be that the 10 
crease in anxiety is retarded only when 2 
is talking about the anxiety-arousing ma a 
rial. In this sense, the anxiety curve begins j 
level off only when there is congruence be 
tween the Ss’ experiencing of the matena 
their awareness of the material, and the 
verbalization of it. This account also suge 2 
that, had there been more time in whicl j 
could experience this congruence, the a a 
might have reduced. When there is not B 
complete congruence, as in the Repress! a 
and Suppression conditions, anxiety consis 
ently increases. 

7: he this over-all increase in conduct 
which appears to be unrelated to the okt 
lar experimental conditions, except Pe 
for Verbalization, one may still compare 3 
conditions in order to discover which AT 
contribute most heavily to the growth of t 4 
anxiety. The results of such comparisons ae 
dicate that repressing Ss generate anxiety 4 
a faster rate than they do in the nonrepressin& 
control condition. One cannot decide from 
these data whether the increasing slope in re- 
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Pression is caused by the imminent cessation 
of repression, or by a simple anticipation of 
the signal denoting the start of another con- 
dition. The control interview was not fol- 
lowed by another condition, as was the case 
with the Repression section. However, an ex- 
amination of the curves in Fig. 2 suggests 
that increases in conductance may not be 
solely determined by anticipation; the RVS 
group does not have as rapid an increase in 
conductance as the RSV group during the 
second interview section, even though there 
is still a third interview section for both 
groups to anticipate. It is suggested that what 
is being anticipated plays at least some part 
in the anticipation response. This further 
suggests that some anxiety-arousing cues are 
being produced in the Ss even though they 
are repressing, as defined by the hypnotic 1n- 
structions, and that these cues increase as the 
point of awareness approaches. Since the Ss 
are not overtly verbalizing about the induced 
threat or about the signal which they may be 
anticipating, it must be assumed that the 
anxiety-arousing cues are being produced 
covertly. If we assume that the Ss were not 
thinking about the threat or the approaching 
signal, according to the hypnotic instructions, 
we must conclude that the anxiety-producing 
cues were being produced without the Ss 
awareness. 


This raises some questi 
ture of awareness. According to Dollard and 


Miller (1950), repression exists when an indi- 
vidual fails to think (produce verbal cues, 
usually) because of the association Lea 
these cues and anxiety. This is essentia ne 
learned avoidance response. If such Were Me 
case, one would expect little or no pa ee 
repressing Ss. This, of course, is not what i 
found. Our data, indicating increasing a 
iety during Repression, suggest that soe 
anxiety-arousing cues were being Pro ee 
when the Ss are assumed, on the basis p i. 
hypnotic instructions, to be unaware o 

threat, Thus there is evidence for the a 
ence of anxiety-producing cues Here 
hess, Dollard and Miller’s hypothesis that ur 
awareness or unconsciousness is defined in 
terms of the absence of such cues is there- 
fore inconsistent with the analysis based = 
our data. It is suggested that awareness e 


ons about the na- 
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defined in terms of some other secondary re- 
sponse to the covert (verbal) anxiety cue- 
producing responses which the unaware Ss ap- 
pear to be making, and that it is these other 
responses (perhaps self-related evaluations) 
which are not being made by repressing Ss. 
That is, awareness may be defined in terms 
of some self-related evaluations which the in- 
dividual may or may not make as responses 
to internal, usually verbal cue-producing re- 
sponses, rather than in terms of the cue-pro- 
ducing responses themselves. 

Hypnosis may be thought of as an indirect 
way of producing the condition of not being 
aware of the covert cues associated with anx- 
iety. There is no guarantee that the Ss were 
indeed unaware of the anxiety-producing cues, 
namely, thoughts about parental conflict. If 
one is willing to accept the validity of the 
posthypnotic instructions in this respect, then 
the rather interesting conclusion must be 
drawn that anxiety increases with equal ra- 
pidity whether S is aware of the covert anx- 
iety-producing cues or not, since the conduct- 
ance curves for Repression and Suppression 
do not differ in slope. This finding that anx- 
iety continues to rise in the Suppression con- 
dition suggests that awareness or insight, of 
itself, is not sufficient to reduce anxiety. 

At the same time, an account of the rela- 
tionship between anxiety and the lifting of 
repression which would predict a direct rela- 
tionship between anxiety and availability of 
anxiety-producing cues would have some diffi- 
culty with these data. With initial verbaliza- 
tion and its profusion and clarity of cues, we 
should expect an even greater increase in the 
anxiety measure. In contrast we find that it 
is only during Verbalization that the increase 
in anxiety tends to slow down. 

This reduction in anxiety increase during 
Verbalization may have a counterpart in the 
positive feelings toward the therapist which 
the RSV Ss tend to show to a greater extent 
than the RVS Ss. It seems probable that the 
verbalization section, occurring last for the 
RSV Ss, leaves the S with a more positive 
feeling because the S has been experiencing 
a lessening of the anxiety increase just prior 
to her rating of the therapist. In contrast the 
increase in anxiety associated with the last 
condition—Suppression—for the RVS Ss may 
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be associated with the tendency of these Ss to 
feel less positive toward the therapist. 

Certain qualitative aspects of the Ss’ be- 
havior in the interviews may provide a clearer 
picture of the nature of these interview ses- 
sions. In all respects, Ss’ verbal behavior was 
natural; it is doubtful that the most insight- 
ful psychologist would discover, from listen- 
ing to the tape recordings, that Ss were per- 
forming according to hypnotic suggestions. 
Of particular interest is the manner in which 
Ss responded to the signal denoting the be- 
ginning of a new experimental condition. In 
no case was there a verbal response relating 
to the signal itself. Some Ss lapsed into silence 
for a few seconds, and then began verbalizing, 
usually with a change to subject matter ap- 
propriate to the new condition. A frequent 
remark from Ss who had been in the Verbali- 
zation condition when the signal was given 
marking the beginning of Suppression was 
“Well, let’s talk about something pleasanter,” 
or “I guess I shouldn't bore you with these 
personal problems.” During Suppression sec- 
tions, particularly in the RSV group, one 
notes frequent references to the parental con- 
flicts of others—friends, relatives, etc., and 
occasionally a spontaneous denial of personal 
conflicts with parents. 

One recording was particularly illuminating 
in the manner in which it reveals the develop- 
ment of associations to the threatening mate- 
rial. The S was in the RSV group. The major 
topic of conversation during Repression was 
S’s interest in a film on intellectual deficiency 
and brain pathology she had recently seen in 
psychology lecture. This film reminded her of 
her friend’s mother, who suffers from multiple 
sclerosis. This conversation was continued in 
the Suppression section, where the major em- 
phasis was on the emotional climate of the 
friend’s home, in relation to the mother’s ill- 
ness. S stressed the frequent conflicts between 
her friend and her friend’s father, growing out 
of the continual stress at home. This con- 
tinued until the Verbalization section began, 
in which S discussed her own conflicts with 
her parents. She introduced the topic by say- 
ing, “Of course, lots of people have problems 
with their parents, even when there isn’t that 
kind of sickness and tension.” Thus the dis- 
cussion of the psychology film seems to have 
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been closely associated with, or at least led 
directly to, a discussion of S’s own problems. 
This may suggest that therapists be cautious 
in deciding that any particular topic is as 
irrelevant as a discussion of a film on brain 
damage at first appears. It is the ability to 
produce behaviors such as these which be- 
come intelligible only when the experimenter 
has knowledge and control of the antecedent 
conditions, that makes the experimental pro- 
cedures used in this research of particular 
value. 


Summary 


An experiment was performed to study the 
effects on anxiety, as measured by GSR re- 
cording, of repression, suppression, and ver- 
balization of threatening material. Ten se- 
lected and trained undergraduate female Ss 
were stimulated to recall conflicts with theit 
parents under hypnosis, and were given post- 
hypnotic suggestions to “not think about” 
(Repression), “think about but not talk 
about” (Suppression), and “talk about” (Ver- 
balization) conflicts with parents to the inter- 
viewer, who conducted a nondirective type 
interview for 45 minutes with each S. Each 
condition occupied 15 minutes of the inter- 
view, with S responding to signals demarcat- 
ing the beginning of each condition as M- 
structed under hypnosis. Skin conductance 
was recorded continuously throughout the 1n- 
terviews, and a scale of attitudes toward the 
therapist given once at the end of a 15-minute 
control interview and again at the end of the 
45-minute interview, constituted the depend- 
ent variables. Skin conductance measures were 
analyzed in terms of differences in slope. The 
findings were as follows: 

1. There was a consistent over-all i 
in conductance throughout the experimental 
session, indicating a continuous growth in 
anxiety regardless of the order of conditions. 

2. The increase in conductance was more 
rapid under Repression than during the con- 
trol interview. 

3. Conductance slopes during 
and Suppression were not found t 


nificantly. 
4. The conductance slopes during Suppres- 


sion were significantly steeper than during 


ncrease 


Repression 
o differ sig- 


a 


< 


+ 
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Verbalization, in which the slopes tended to 
flatten, 

Bs Ss whose last interview section was Ver- 
saa showed a tendency toward more 
n Prie shifts in attitudes toward the thera- 
3 S than Ss whose last interview section was 
uppression. However, this difference was not 
significant. 


Received May 9, 1958. 
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Tomkins (1947) has introduced the con- 
cept of remoteness between the TAT narrator 
and the TAT figures as an important inter- 
pretive device. This concept assumes that a 
hierarchy of impulse acceptance can be es- 
tablished for the narrator. For example, Pio- 
trowski (1950) has stated: “. . . the most 
acceptable drives are projected into TAT fig- 
ures who resemble the testee by age, sex, race, 
social status, etc. Less acceptable drives are 
ascribed to figures of the same sex but of 
different age. Actions which are still less ac- 
ceptable are projected into figures of the op- 
posite sex. Tendencies that possess a still 
higher degree of unacceptability are assigned 
to figures both of opposite sex and of differ- 
ent age” (p. 108). Van Lennep (1948, 1951) 
also has written extensively on this general 
theme and regards the individual who utilizes 
projection as manifesting an attempt to “dis- 
tance” himself from ego-threatening self-at- 
tributes. 

The present study was designed to test the 
validity of Piotrowski’s assumption, and the 
following hypothesis was formulated for this 
purpose: The less acceptable certain behavior 
is to the narrator, the more he will attribute 
such behavior to TAT figures dissimilar to 
himself along a continuum of age and sex. 


Method 


Twenty-one male neuropsychiatric patients 
at the Denver Veterans Administration Hos- 
pital were used as Ss. They were selected from 


1 The authors wish to express their appreciation to 
Robert Fadeley, John Thompson, and Virgil Willis, 
who assisted in testing some of the subjects. 

2 Now at Harvard University. 


patients referred to the Psychology Service for 
diagnostic testing. No psychotic patients were 
used since it was felt that there would be 4 
higher probability of their misunderstanding 
the task. > 

Ss were asked to write TAT stories using 
Cards 1, 4, 6GF, 7BM, 7GF, and 13F. These 
cards were selected since they include ap- 
proximately an equal number of males and 
females (five and six, respectively). Further, 
the figures on these cards represent a wide 
age range. The female figure in the back- 
ground of Card 4 was not used, as only two 
Ss referred to it. : 

Ss wrote the stories with the experimenter 
absent from the testing room. This pron 
has been found by Bernstein (1956) to elici 
freer expression of feeling in TAT stories. 
following instructions were read to eal 
and left with him in written form, aft 
was felt that he understood the nature of the 


task: 


er it 


This is a test of imagination, one form of ine 
gence, The cards which you have been given ae 
pictures on them. You are to look at them, one for 
time, and write as dramatic a story as you ei es 
each one. Tell what has led up to the event sho 
in the picture, describe what is happening aie 
moment, what the characters are feeling and ei 
ing, and then give the outcome. Try to spen 2 
five minutes on each story. 

When you have finished writing the story, a 
the age of each of the people in the picture on 
write the ages at the bottom of the paper UP’ 
which you have written the story. 


guess 


To test the hypothesis, it was necessary to 
quantify the variables of (a) acceptability- 
of-behavior for each TAT figure, and (b) the 
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age-sex dissimilarity between S and each TAT 
figure. 

The acceptability-of-behavior of each TAT 
figure was measured by first classifying all 
the scoreable behavior in S’s stories accord- 
ing to the scheme of needs proposed by Mur- 
ray (1938). For example, if S wrote about 
one figure, “This man has just shouted angrily 
at the other person,” this behavior was classi- 
fied under the need, Verbal Aggression. After 
all the needs had been extracted from S's 
stories, he was seen in a second session. He 
was given a pack of small cards, each of 
which contained a behavioral description rep- 
resenting one of the needs he had expressed 
in some story,” and asked (under the guise of 
this being another test) to rank-order these 
behavioral descriptions in terms of their ac- 
Ceptability to him, Instructions were: 
fully. Then ar- 


n according to 
d on each is, 


In this test, read all the cards care 
range them on the table in a colum: 
how acceptable the behavior describe 
from your point of view. 

When you finish, the card wit 
= is most acceptable will be 
column and the card with the 
havior will be at the bottom. The rest of the cards 
in the column will be in order of their acceptable 

Think of “acceptable behavior” as the kind wl = 
you would be comfortable in claiming as your oan 
the kind you feel is the best to use, generally speak- 
ing, 

Take your time and feel free to move the Ge 
around until you have them in just the order 
you want them. 


h the behavior you 
at the top of the 
least acceptable be- 


The rank numbers assigned to the needs S 


had expressed were used to compute = ea 
ceptability-of-behavior score for each Te 
figure. This score was found by summing 
rank numbers of all the needs attributed ip 
a particular figure. For example, if a pace 
behavior was described by three needs, 
rank numbers given these needs were summe , 
and the sum became the acceptability-0 "fot 
havior score for that figure. These scores oF 
the eleven TAT figures were then aE 
dered, thus arranging the figures Hage 
archy of acceptability-of-beha 
The second variable, dissim! 
S and TAT figures, was quanti 


n for the need, Verbal 
f people, iS sar- 


vior. 
ilarity between 


fied by order- 


? For example, the descriptio) 
&gression, was: “He makes fun o 
castic, and quarrelsome.” 
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ing the figures onto a continuum of age and 
sex. Differences were computed between the 
age of S and the age he estimated for each 
TAT figure. The rank-order differences for 
the five male figures were assigned Ranks 1-5, 
and the age differences of the female figures 
provided Ranks 6-11. By this method, both 
age and sex differences were included in the 
dissimilarity continuum, as required by the 
hypothesis. 

Finally, a rank-order correlation between 
the ranks of the acceptability-of-behavior 
scores and the dissimilarity ranks of the 11 
TAT figures was computed for each subject. 


Results and Discussion 


Of the 21 Ss, 10 wrote stories in which 
needs were attributed to each of the TAT 
figures. A rho correlation for each of these 
10 Ss was computed between the ranks of the 
acceptability-of-behavior scores and age-sex 
dissimilarity ranks of the total 11 TAT fig- 
ures. This group is referred to as “nondis- 
tanciators.” It will be noted that none of 
these correlations, shown in Table 1, are sig- 
nificant. 

A rho correlation was computed for each 
of the remaining Ss who did not attribute 
needs to all the figures in the stories written. 


Table 1 


Correlations Between Acceptability-of-Behavior 
and Age-Sex Dissimilarity Scores 


Ss Failing to Attribute 


Ss Attributing Needs Needs to All TAT 


to All TAT Figures Figures 
Ss Rho S Rho 
1 —.29 4 .75* 
2 —.31 5 .96** 
3 —.26 6 .62* 
7 —.21 8 .82* 
9 28 12 .69* 
10 —.07 14 wae 
11 45 15 .81** 
13 .24 16 215" 
17 —.11 18 .68* 
20 Al 19 1 
21 BS 


* Significant at .05 level. 
** Significant at .01 level. 
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The correlation for each of these Ss is be- 
tween the ranks of the acceptability-of-be- 
havior scores and age-sex dissimilarity ranks 
of the TAT figures to which the particular S 
had attributed needs. Thus, the rhos from 
these 11 Ss are based upon the data from 
different numbers of TAT figures which vary 
from 5 to 10. These individual correlations 
also are shown in Table 1. Of these 11, 10 
are significant at or beyond the .05 level of 
confidence. This group of Ss is referred to as 
the “distanciators.” 

These findings focused attention upon the 
individual differences in distanciation, i.e., the 
fact that Ss who failed to attribute needs to 
all the TAT figures did distanciate, whereas 
Ss who attributed needs to all the figures did 
not. This raises the question of what subject 
variables may be producing such variance. In 
line with this, the length of hospitalization 
for the two groups was examined. It was 
found that the distanciators had been hos- 
pitalized for a mean period of 4.40 weeks 
while the nondistanciators had been hospital- 
ized for a mean period of 8.64 weeks. The 
difference in length of hospitalization between 
the two groups, using the Mann-Whitney U 
test, yields a U of 24 which, for the size of 
the two groups, is significant at the .025 level. 
(The sigmas of the distanciators and non- 
distanciators are, respectively, 4.23 and 7.51.) 

In retrospect, this finding is logically con- 
sistent with some emerging theoretical formu- 
lations which the authors are beginning to 
construct regarding the manner in which un- 
acceptable behavior is handled. It would ap- 
pear that the degree of distanciation mani- 
fested is related to certain factors which are 
part of the situation in which S behaves. For 
example, the Ss in this study represent hos- 
pitalized, emotionally disturbed individuals, 
most of whom were currently having diffi- 
culty with their usual defenses of repression 
and denial. For some, it was the first time in 
a therapeutic environment * which typically 
encourages a frank examination of behavior. 
This, plus the experience of psychotherapy 


4Since the hospital in which this study was con- 
ducted is a teaching center, only patients with acute 
psychiatric conditions which are expected to respond 
to relatively short-term intensive treatment are ad- 


mitted. 
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which most were receiving in some form, 
might operate to bring their needs closer to 
awareness. This possible factor, coupled with 
the reduction in fear of realizing and admit- 
ting the existence of many undesirable per- 
sonal characteristics could vary with the 
length of time in the situation (the thera- 
peutic environment). This possibility is con- 
sistent with the finding that the distanciators, 
hospitalized for a shorter length of time, 
failed to attribute needs to every TAT fig- 
ure. Their stories are thus more evasive, if 
we interpret this failure to attribute needs to 
all the figures in TAT stories as evasion. 

The results seem to indicate that the as- 
sumption set forth by Piotrowski holds, but 
only under certain conditions. The next task 
must be to study more fully the factors 1m 
the situation which comprise these conditions. 
Further research is now in progress to deter- 
mine whether differential stress experimen- 
tally generated by verbal cues affects the 
degree of distanciation manifested in TAT 
stories. 


Summary 


This study tested an assumption of Pio- 
trowski that the less acceptable certain be- 
havior is to the TAT narrator, the more he 
will attribute such behavior to TAT figures 
dissimilar to himself along a continuum ° 
age and sex. Twenty-one male neurotic p- 
tients at the Denver VA Hospital wrote 
stories to six selected TAT cards, and esti- 
mated the age of each TAT figure. These 
stories were scored for a set of standar 
needs. During a second session, each S rank- 
ordered all the needs which he had attributed 
to the TAT figures, using a criterion of “Pel 
sonally acceptable behavior.” d 

A rho correlation for each § was compute 
between the ranks of the acceptability-of-be- 
havior scores and the age-sex dissimilarity 
ranks. Ten Ss wrote stories attributing nee¢S 
to all the TAT figures; none of the correla- 
tions for these Ss was significant. Eleven Ss 
failed to attribute needs to all TAT figures; 
10 of the 11 correlations for these Ss were 


significant. ; 

These findings demonstrate that Piotrow- 
ski’s assumption is valid only under certain 
conditions. In the present study, length of 


x 
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hospitalization appears to be a relevant vari- 
able. 


Received May 12, 1058. 
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MMPI DIFFERENCES BETWEEN PARENTS OF 
DISTURBED AND NONDISTURBED 
CHILDREN? 
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It is a widely held clinical notion that the 
parents of behaviorally disturbed children are 
themselves more maladjusted than the parents 
of nondisturbed children. This notion is gen- 
erally supported by clinical evidence (i.e., so- 
cial work and psychiatric interviews) and fol- 
lows from the relatively large amount of 
research (e.g., Baldwin, Kalhorn, & Breese, 
1945; Brown, 1942) demonstrating the ef- 
fects of parental attitudes and personality 
upon child behavior. However, the author 
knows of no studies which directly test this 
hypothesis by comparing parents of clinically 
disturbed children with parents of “normal” 
children in terms of some adjustive criteria. 

It is conceivable that intensive study of the 
parents of nonproblem children may reveal 
a degree of pathology in their backgrounds 
similar to that of parents of disturbed chil- 
dren. For example, Goodstein and Dahlstrom 
(1956) found no significant Minnesota Multi- 
phasic Personality Inventory (MMPI) differ- 
ences between parents of stuttering and non- 
stuttering children. The present research is in 
part an application of their basic design to a 
different experimental population. It also in- 
vestigates possible parental syndromes within 
the disturbed group which may differentially 
contribute to certain patterns of child pa- 
thology, such as acting-out vs. nonacting-out 
problems. 


Subjects and Method of Data Collection 


The booklet form of the MMPI was ad- 
ministered as part of the standard diagnostic 
procedure to all parents bringing a child for 

1The author is indebted to the child psychiatry 


staff at the University of North Carolina for their 
cooperation in collecting the data for this study. 


evaluation to the Department of Psychiatry 
at the University of North Carolina Medical 
School from April, 1956 to June, 1957. In 
order to be included in the final analysis, both 
parents had to have taken the test and their 
child judged by the clinic staff as neither 
mentally defective nor organically impaired. 
Forty-nine sets of parents (all Caucasian) 
met the above criteria. 

The comparison group data were drawn 
from the population of control parents used 
in the Goodstein and Dahlstrom study 
(1956).* These were parents of essentially 
physically normal, white children with no 
known behavioral disturbances. They hi, 
sisted of volunteers from PTAs, me 
groups, etc. in and around the Iowa area. 
all cases (as with the experimental ae 
both parents were living together at the tim 
of the study. 

Each experimental parent was matched i 
a control parent on the basis of age, ed f 
tion, rural or urban residence, and, in pi 
case of fathers, socioeconomic status. In 0 
der to achieve the closest possible matching, 
the control mothers and fathers were matche 
separately with the experimental mothers 2”! 
fathers rather than by families. 


The mean age of the experimental fathers _ 


was 40.49 years (range, 30 to 58 years), with 
average education of 11.59 years (range, 4 
to 20 years). That of the control fathers wa 
40.79 years (range, 30 to 58 years), with a 
erage education of 12.88 years (range, es 
20 years). The mean age of the experimen 

2 A special debt of gratitude is owed Grant Dabl- 


f i k= 
instakingly provided the matched sa 
ee Mediate MMPIs from the larger group 


used in his study. 
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MMPI of Parents of Disturbed and Nondisturbed Children 


Table 1 


M > set aE > 
teans, SDs, and Significance of Difference Between 
Means of Experimental and Control Fathers 


Experimental Fathers Control Fathers 


(N = 49) (N = 49) 
Scales Mean Sp Mean SD b 
> 
I 86 28.5 30 90 13 
F 4.8 22 £0 25 “11 
K 3.6 25 36 33 Toi 
T 16.1 5.1 161 54 0.0 
> © 5.0 52 34 3.9% 
61 4.7 53 36 35% 
po 2 48 5 4&7 35" 
a 90 48 Ege) eT 
mT 44 37C«4GC 
D 54 2.4 52 26 14 
Se 57 4.7 52 45 2.4* 
d 53 44 52 5.2 0.0 
Ma 52 41 53 as Ol 
4 13.9 9.9 11.2 7.3 16 


A ini 2 
lage 9 clinical scales (Hs through Ma) are in T-score units 
BAM Pyne correction. The others are raw scores. 
Signa UCS are based on raw scores. 
s Significant between the .05 and .01 levels of confidence. 
ignificant at greater than the .01 level of confidence. 


Mothers was 36.84 years (range, 26 to 55 
years), with average education of 12.37 years 
Tange, 2 to 20 years). That of the control 
Mothers was 37.31 years (range, 27 to 54 
years), with average education of 13.16 years 
Tange, 8 to 21 years). 

Eighty-two per cent of the experimental 
families had urban residences, whereas 67% 
of the control group had urban residences. 
Over 90% in both groups were Protestants, 
and they were largely lower middle-class 
families, 

The MMPs were hand-scored for the four 
Validity scales, nine clinical scales, and the 
aylor anxiety scale (1953). i 


Results 


Between Group Comparisons 

None of the profiles in either group were 
excluded on the basis of the validity scale 
ae With the exception of two experimen- 
al fathers who slightly exceeded a raw score 
of 7 on the L scale, the experimental group 
Met the criteria used by Goodstein and Dahl- 
Strom (1956) to exclude parents whose va- 
idity scale scores indicated a significant de- 
Sree of dissimulation. 
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Since the T scores of the experimental 
fathers were significantly higher on the Hs, 
Mf, and Ma scales and significantly lower on 
the Pa and Anxiety (A) scales than the ex- 
perimental mothers, the sexes were not com- 
bined in the subsequent comparisons with the 
control groups. The control fathers had sig- 
nificantly higher T scores than the control 
mothers on the Mf and Ma scales. 

For the sake of reader convenience, the 
nine clinical scale scores (Hs to Ma) in 
Tables 1 and 2 are reported in terms of stand- 
ard scores (T scores) rounded off to the near- 
est whole number, although all computations 
are based on the more exact raw scores. As 
shown in Table 1, the experimental fathers 
had significantly higher mean scores on the 
Hs, D, Hy, and Pt scales than the control 
fathers. Table 2 shows that the experimental 
mothers scored significantly higher on the F, 
D, Hy, Pd, Pa, Pt, and A scales, whereas the 
control mothers had a significantly larger 
score on the K scale. 

The various groups were compared as to 
severity of disturbance by counting the num- 
ber of individuals in each group who had one 
or more T scores on the nine clinical scales at 


Table 2 


Means, SDs, and Significance of Difference Between 
Means of Experimental and Control Mothers 


Experimental Mothers Control Mothers 


(N = 49) (N = 49) 

Scales Mean SD Mean SD Gs 

? 5.9 25.2 133 43 1.3 
L 4.5 2i 3.7 2.0 1.9 
F 4.0 3.6 2.5 1.8 2:5" 
K 14.5 4.9 16.9 4.3 2.6** 
Hs 54 4.9 52 3.6 1.1 
D 59 7.0 52 5.9 2er 
Hy 60 6.2 56 4.4 2:3* 
Pd 61 5.2 53 49 28** 
Mf 48 5.0 49 3.9 ial 
Pa 58 3.7 54 2.3 2.4* 
Pi 58 (es) 51 4.7 215£ 
Sc 54 8.9 52 4.8 1.0 
Ma 49 3.8 48 2.7 0.3 
A 18.9 9.7 12.5 7.3 3.4% 


a The 9 clinical scales (Hs through Ma) are in T-score units 
including the K correction. The others are raw scores. 


b All ¢ values are based on raw scores. 
* Significant between the .05 and .01 levels of confidence, 
+t Significant at greater than the .01 level of confidence, 
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70 or above (the usual cutting score for psy- 
chiatric disturbance). Twenty-six of the ex- 
perimental fathers had one or more T scores 
at or above 70 as compared to 15 of the con- 
trol fathers, and 22 of the experimental moth- 
ers had one or more scores in this range as 
compared to only 9 of the control mothers. 
Chi square = 5.06 (p < .03) for the fathers, 
and chi square = 7.98 (p < .01) in the case 
of the mothers. 

It is also significant that there were 10 
mothers in the experimental group with 3 or 
more T scores above 70 and only 2 such 
mothers in the control group (chi square = 
6.10, p < .02). 

Since present-day MMPI interpretation 
places a great deal of emphasis on response 
patterns as well as elevation of scores, the 
various groups were compared in terms of 
relative frequency of occurrence of certain 
two-digit high point codes (i.e., the top two 
scores). Neither the fathers nor mothers in 
either group had a frequency in any given 
code pair exceeding five, and in all four 
groups there were almost as many different 
high point code pairs as there were people. 

A further analysis of the high point code 
was made by counting the frequency of oc- 
currence of each clinical scale in either first 
or second place within each group. In only 
one instance was a significant difference ob- 
tained between experimental and control fa- 
thers or between experimental and control 
mothers. Twelve of the experimental fathers 
had an Hs score in either first or second place 
as compared to only three of the control fa- 
thers. This difference is significant at greater 
than the .02 level of confidence (chi square = 
6.16). 


Within Group Analysis 


In an attempt to gain some further under- 
standing of the nature of the relationship (if 
any) between parental pathology and child 
disturbance patterns, the experimental group 
was divided into four subgroups on the basis 
of symptomatology exhibited by the child as 
follows: 

1. The schizophrenic group (S) consisted of par- 


ents whose children (W = 9) were diagnosed as child- 
hood schizophrenics or severely schizoid (i.e. ex- 
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hibited bizarre thought processes and/or markedly 
withdrawn and peculiar behavior). 

2. Parents of children (N = 10) who had been re- 
ferred to the clinic because of delinquent or antiso- 


cial behavior were placed in the acting-out group x 


(AO). 

3. The physical complaint group (PC) was com- 
posed of parents whose children (N = 18) were suf- 
fering from various bodily symptoms for which no 
physiological basis could be determined (ranging 
from enuresis to headaches). 

4. The neurotic group (N) was constituted of par- 
ents of children (N =12) who demonstrated behav- 
iors of a nonacting-out variety (such as difficulties 
in academic learning) but who were not considered 
as severely disturbed as the children in Group 1. 


Since the parents of male children had no 
MMPI clinical scales significantly different 
from the parents of female progeny, sex dif- 
ferences among the children were not consid- 
ered in composing the above groups. There 
were 34 males and 15 females ranging in age 
from 4 to 17 years. Four of the girls were in 
the schizophrenic group, none in the acting- 
out group, eight in the physical complainers 
and three in the neurotic group. 

The four validity, nine clinical, and Taylor 
anxiety scores of each set of fathers in one 
group were compared with the fathers in each 
of the other three groups (i.e., S fathers were 
compared with AO fathers and with PC fa- 
thers, etc.). £ tests of the difference between 
means were also computed in the same nog 
ner for the mothers, making a grand total = 
12 sets of comparisons (14 in a set) or 16 
é tests. : 

Only eight of these ¢ tests reached or sur 
passed the .05 level of confidence, any oF 4 
of which may be significant on a chance basis. 
However, five of the significant differences 
were found with respect to the Mf scale whic 
may lend some validity to them. sanal 

The S mothers were higher (more feminine? 
on the Mf scale than the AO mothers (¢ Te 
2.5, p < .05). Fathers of both gshizopi y 
and neurotic children had significantly hig 
Mf scores than fathers of acting-out er 
physical complaint children as follows: 
tween S and AO (¢ = 3.7, p < .05), ie 
S and PC (t= 2.9, p. .05), between N a 
AO (t= 2.54, p= < .05), and between 
and PC (t = 2.69, p < .05). The AO fathers 
had a higher mean Pd score than the S fa- 


ee 


ant 


MMPI of Parents of Disturbed and Nondisturbed Children 


thers which just fails to reach significance at 
the .05 level. The N fathers were significantly 
lower on the D scale and significantly higher 
on the Ma scale than the PC fathers (t = 
4.22, p < 01 and £= 2.37, p < .05, respec- 
tively). 

On the basis of the number of individuals 
With one or more T scores at or above 70, 
the S and N mothers combined were less 
severely disturbed than the AO and PC moth- 
ers (chi square = 4.13, p < .05). Similar dif- 
ferences were not found in the case of the fa- 
thers. A pattern analysis revealed no signifi- 
cant differences between any of the groups. 


Discussion 


Before interpreting these results the prob- 
lem of regional differences between the ex- 
perimental and control parents must be con- 
sidered. Although previous studies (Welsh & 
Dahlstrom, 1956) have found various MMPI 
scales to differ significantly as a function af 
Certain demographic variables, region pet se 
does not appear to have this effect. Goodstein 
(1954) failed to demonstrate regional differ- 
ences among large groups of male under- 
Staduates at eight different colleges scattere 
throughout the United States. 

In general, then, these results support the 
major hypothesis that parents of disturbed 
children are themselves more disturbed than 
the parents of nondisturbed children. Of 
Course, this study does not enable us to de- 
termine whether the elevated MMPI scores 
of the experimental parents are related to the 
etiology of their children’s problems or are a 
Tesult of them or both. : 

While the mean scores of the experim 
Parents indicate that they tend to bemo 
maladjusted than adults in general, they cer- 
tainly do not appear to be as abnormal as 
adults who seek psychiatric help for them- 
selves, As a matter of fact, the majority have 
Scores more comparable to that of a normal 
8roup and as revealed by the pattern analysis 
they do not fit into the usual clinical cate- 
Sories. This finding should be considered in 
deciding upon a course of therapy with par- 
ents who bring their children for psychiatric 
or psychological aid. n 

ecause of the large within-group vat 


ental 


ance 
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on any one MMPI scale, the attributing of 
psychologically incapacitating characteristics 
to the experimental parents on the basis of 
mean scores is at best indicative of certain 
group trends and does not necessarily apply 
to any individual within the group. Within 
the context of the above reservation, the ele- 
vated scales of the fathers indicate that they 
tend to be weak, ineffectual males with an 
assortment of somatic concerns, whereas the 
experimental mothers are much more likely 
to act out their angry and disturbed feelings 
in relation to others as evidenced by their 
relatively high Pd and Pa scores. The major 
exception to this general characterization oc- 
curs in the case of the fathers of acting-out 
children who tend to have significantly higher 
Pd scores than any other group of males. 
It would also appear that the experimental 
mothers demonstrate more disturbed verbal 
and overt behavior as compared to normal 
mothers than do the experimental fathers in 
comparison with the control fathers. In all 
cases, these findings are consonant with clini- 
cal impressions. 

Essentially, the present study failed to es- 
tablish any definitive relationships between 
parental pathology and the kinds of behavior 
problems exhibited by their children. This 
may be a function of the inapplicability of 
the MMPI for such fine discriminations, the 
lack of within group homogeneity, the small 
size of the groups, or any combination of 
these factors. 

One somewhat contradictory finding from 
a common sense point of view is that the 
mothers of the schizophrenic and neurotic 
children (who are ordinarily considered the 
more severely disturbed children) showed less 
disturbance on the MMPI than the mothers 
of acting-out and physically complaining chil- 
dren. An analysis of the socioeconomic back- 
ground of the parents indicates a tendency 
for the parents of the schizophrenic and neu- 
rotic children to have a somewhat higher 
socioeconomic status than the parents of the 
other groups. As a consequence they may be 
somewhat less prone to answer the MMPI 
items in a deviant direction, and more likely 
to inhibit antisocial behavior. They may also 
be more enlightened concerning the functional 
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basis of some physical disorders and thus less 
likely to reward them. Cultural differences 
may also explain the higher Mf scores of the 
S and N fathers. 

It is obvious that this study raises more 
questions than it answers. The next step 
would be the initiation of a series of investi- 
gations to determine the parental behavioral 
patterns which are the basis for specific child- 
hood problems. 


Summary 


The MMPI was used to compare 49 sets of 
parents of clinically disturbed children (ex- 
perimental group) with 49 fathers and 49 
mothers of nondisturbed children (control 
group). The mean differences between the 
experimental and control groups on the 14 
MMPI scales analyzed and a frequency count 
of the number of individuals in each group 
who had one or more clinical scales at or 
above a T score of 70 (the usual psychiatric 
cutting score) strongly supported the general 
clinical impression that both fathers and 
mothers of disturbed children are themselves 
significantly more maladjusted than the fa- 
thers and mothers of nondisturbed children, 
However, a pattern analysis and a visual com- 
parison with the typical norms for psychi- 
atrically disturbed adults indicated that the 
experimental parents are more like “normal” 
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parents than they are like adults who seek 
psychiatric help for themselves. 

An attempt to relate MMPI syndromes 
within the experimental group to various 
kinds of behavior problems exhibited by their 
children essentially met with failure. The dif- 
ferences that were found (primarily on the 
Mf scale) between parents of schizophrenic 
and neurotic children as compared to parents 
of acting-out and physical-complaining chil- 
dren seemed to be most parsimoniously ac 
counted for on a cultural basis. 


Received May 14, 1958. 
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RESPONSES TO THE WORDING OF PERSONALITY 
TEST ITEMS 


CHARLES HANLEY 
Michigan State University 


The discovery of “acquiescence” in person- 


ality tests, having led to considerable research 


in recent years, seems likely to continue its 
influence in the near future. Studies have 
tacitly assumed that the response set is a 
unitary source of test variance, perhaps be- 
cause Cronbach (1950), in his influential ar- 
ticle on the topic, attributed to acquiescence 
such diverse behaviors as checking misspelled 
Words on a spelling test, checking “like” on 
Interest inventories, checking “agree” on atti- 
tudes, and checking “no” on a temperament 
schedule. Little attention, however, seems to 
have been given to the possibility that there 
might be more than one kind of acquiescence. 
Acquiescence may be a personality trait. 
Leavitt, Hax, and Roche (1955), for example, 
related the set to “authoritarian submission,” 
and it is certain that the future will bring 
more studies of the personality correlates of 
acquiescence. On the other hand, Cronbach 
(1950) suggested that the set will usually not 
have predictive value, implying that acquies- 
cence is mainly a function of the test situa- 
tion itself. Consistent with this belief are as- 
sumptions that acquiescence occurs most often 
when items are ambiguous (Cronbach, 1950), 
or “controversial” (Fricke, 1956). Accepting 
the hypothesis that the nature of the test 
items influences the response set, the pres- 
ent study explores the possibility that there 
are different “acquiescences,” and that these 
include responses to specific types of item 
wording. : 
An early instance of acquiescence was given 
by Lorge (Lorge, 1937; see Cronbach, 1950 
for fuller discussion), who found a general 
tendency to like (or dislike) items on the 
Strong Interest Inventory; his long “gen-like 
scale had high internal consistency- It is pos- 
sible that systematic differences in the man- 
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ner subjects defined the word “like” con- 
tributed to the reliability of the dimension. 
A subject who defined the word strictly (“It 
must mean really like”) would, other things 
being equal, have few likes on the test. One 
who adopted a loose definition (“Oh sure, I 
like that”) would check many likes. Even 
though both individuals had identical under- 
lying attitudes toward the activities described 
in the items, the systematic difference in defi- 
nition of the key word, “like,” would produce 
“gen-like” behavior. 

“Like” is but one of many terms that might 
elicit systematic differences in interpretation: 
“often,” “wish,” etc. are common in person- 
ality tests. It also is possible that relative 
strictness in defining one key word is unre- 
lated to the manner in which others are inter- 
preted. If this occurs, acquiescences, rather 
than acquiescence, characterize personality in- 
ventories. The present study produces evi- 
dence on this point. 


Procedure 


Exploratory analysis of responses to the 
Minnesota Multiphasic Personality Inventory 
revealed that internally consistent scales could 
be defined solely from item stems (e.g., “I 
often,” “I have had”). MMPI items, however, 
separate deviants from normals, and item con- 
tent tends to describe personality difficulties. 
The reliability of the provisional scales thus 
might be due to item content rather than indi- 
vidual differences in interpretation of wording. 
For this reason, six new scales were devised, 
each with 20 items. The investigator, lacking 
a pool of random meaningful items, attempted 
to vary content and avoid measuring unitary 
personality traits. The scales, mixed in a true- 
false inventory, were given to 59 males and 
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63 female students in undergraduate psychol- 
ogy courses at Michigan State University.t A 
score on a given scale consists of the number 
of items marked “true.” 

The Like scale consists of 20 items headed 
by the words “I like” (e.g., I like work that 
calls for concentration and carefulness, I like 
picnics, etc.). Four other scales are headed “I 
wish,” “I never,” “I have had,” and “I often.” 
The sixth scale, Global, differs in that its 
items have no common stem. Item wording 
on the Global scale was designed to parallel 
the material in the California F Scale and 
similar attitude measures, in that self refer- 
ence is absent, and agreement with broad, or 
ambiguous, or somewhat grandiloquent atti- 
tudes is asked for. It was believed that scores 
would be determined in part by how critical 
an S was in dealing with items (i.e., critical 
Ss would disagree and less critical persons 
agree). Items ranged from the esoteric (The 
real rewards of true religious experience come 
not from earthly prosperity or hope of future 
salvation, but rather from sublime feelings 
which defy description with our limited vo- 


1 Copies of the inventory may be obtained from 
the author. 
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Table 1 


Internal Consistency of the Scales 


Kuder-Richardson Formula 
20 Reliability 


Scale 59 Males 63 Females 
I often 600 601 
I wish 537 638 
Global 422 522 
I like 428 .289 
I never 406 337 
I have had 393 £096 


cabularies) to the niore prosaic (It is easier 
to punish people than to judge them). 


Results 


Data are presented separately for the sexes- 
The internal consistencies of the six scales, 
estimated by Kuder-Richardson Formula 20, 
are shown in Table 1. Moderate reliability 
characterizes the measures, the exception be- 
ing Have Had in women. The scales are short 
and have not been improved by item analy- 
sis, but the evidence for internal consistency 
is clear. The reliability of the Like scale is 


Table 2 
Empirical and Theoretical (in Parentheses) Correlations ** Among Scales 
(Males above, females below diagonal) a 
Scale 
H 
Scale O wW G E N J 
—. 7 eas = — 06 42 
I — F A i 
=. ige = Gh Go 6) (49) ie?) 
15 
I wish W) 3 = 30 03 06 : 
wis! (W) fae -= ba (48) (47) (46) 
m 21 36 
Global G 2 31 D 2% ; 
o (G) (36) (58) = (42) (41) (41) 
24 
I like (L) 05 35 02 = 03 ; 
(42) (43) (39) — (42) (41) 
Pan —.11 
I r (N) —.07 = .29 —.35 
jii as Go ÜD BD - % 
—.11 = 
ave had (H) AL 46 24 16 ` P 
I have had ( (24) (28) (22) (17) (.18) 


i a ively. 
* Values of .26 and .25 are significant at the .05 level for males and females, respectively. 
Values of .26 and .25 
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Table 3 


Unrotated First Centroid Factor Loadings 
and Communalities 


Factor Factor 
Loading Communality 
Ba Stile ” Men Women Men Women 
Lof = - a 
often r m = is 
s 534 A89 .285 .239 
ope 401 714 161 510 
con 633.264 401 -070 
Eie 313 494 9s 24 
They 176 —.308 031 .095 
ave had 36 = 3190 
ain ais ge gee 
quite comparable to Lorge’s results (see Cron- 


ee ee provided allowance js made or 
T erence in number of items: caress 
Wa scales are given 1n Table 2. b 
m ile systematic responses occurred, results 
ay have been due to an influence common 


t g 0 
© all six measures. The internal consistency 


of 

an the Often scale, for example, could have 

arisen because of general acquiescence (or 
There are 


at Is combination of influences). 
at least two ways to examine this P 
ne of these, factor analysis, 
put leads to difficulties. First 
ae centroid factor analysis ( 
onl largest correlation aS a 
G ry) are shown in Table 3, togetne aih 
e communality of the scale attributable 
the first factor. The Have Had scale in women 
Was not included because of its Jow internal 
Consistency. 
Oe ion factor communalities are cE 
i : ag | able 1, 
i the corresponding entries in nae 


is seen that reliabilities usually 47° iiti 
ommunalities 


ase of the 


ossibility- 
rthodox 


a approximately equal, 
i lobal scale in men, it might see 
© hypothesize a general acquiesc 


coefficient sets a lower 


ae To the extent that 

teens reflect sources of varianc 
wins the measure will have a 
pr other tests of similar item 
Present study, the use of K-R 
Toof,” rather than a “floor,” on expecte 
is bi means that the analysis is conservative ( 
iS biased against the hypothesis of 

item wording). 


greater communality 
heterogeneity- In the 
20 reliability aS a 
ted correla- 
ie, it 


variance specific 
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The contrary is true in women, however, 
where the Global scale’s first factor commu- 
nality is much smaller than its reliability. If 
the reliabilities and communalities are aver- 
aged for the two sexes, it will be seen that 
the first factor accounts for less than half of 
the reliable variance of the scales. 

There is reason to doubt whether even this 
contribution to scale variance can be at- 
tributed to general acquiescence. The first 
centroid factor can be the average of two or 
more independent common factors. Further 
extraction of factors and rotation of axes 
would be necessary to settle the question. 
Subjecting the present data to multiple fac- 
tor analysis, on the other hand, encounters the 
objection that there are very few tests. Fur- 
thermore, if rotation to any criterion were at- 
tempted, the general factor loadings would 
decrease—less evidence of general acquies- 
cence must result. Factor analysis is unsatis- 
factory for these reasons, but a second simple 
approach is possible. 

The hypothesis being considered may be 
stated: “The internal consistency of each 
scale is due to general acquiescence.” Since it 
is assumed that the method of item selection 
has randomized content factors among the 
scales, an important deduction follows from 
this proposition. The scales will correlate with 
one another, and the magnitude of their in- 
tercorrelations will be a function of their reli- 
abilities. When reliabilities can be estimated 
as in the present study, it is possible to ant 
struct a matrix of correlations expected on 
the hypothesis that general acquiescence is 
responsible for internal consistency. Each hy- 
pothetical coefficient is given by the formula 
for the correction for attenuation entered with 
a “true” value of 1.00 and the relevant reli- 
abilities, and solving for the “empirical” co- 
efficient. Each hypothetical correlation thus 
is given by the product of the square roots of 
the reliabilities involved. 

These hypothetical coefficients are shown in 
Table 2 in parentheses below the correspond- 
ing actual values. In most cases, empirical 
correlations are markedly smaller than theo- 
retical coefficients. In view of its internal con- 
sistency, the Wish scale in men, for example 
should have correlations of .57, .48, .48 47, 
and .46 with the other scales, if the accuies- 
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cence hypothesis is correct. The actual cor- 
relations of .21, .30, .03, .06, and .15, respec- 
tively, are much lower. It follows that the in- 
ternal consistency of this scale is too large to 
have been produced entirely by acquiescence 
shared with other measures. The alternate hy- 
pothesis, the existence of a response set spe- 
cific to items headed “I wish,” is thereby sup- 
ported. Similar reasoning applies to the other 
scales, with the exception of the Have Had 
measure in women. This scale has virtually 
zero internal consistency. The fact that it cor- 
relates with the other measures must be at- 
tributed to the operation of small independent 
factors shared with other scales. While corre- 
lations between tests have been treated as oc- 
curring from general acquiescence, this last 
finding suggests the presence of influences not 
contributing to internal consistency but op- 
erating to produce correlation between meas- 
ures that on first sight might seem the result 
of general acquiescence. 

ACE scores were available for 36 males and 
49 females. One correlation with the scales 
proved statistically significant (.05 level). 
—.34 between ACE and the Global scale in 
males (the corresponding value for females 
was —.16). This result lends some support 
to the assumption that responses to Global 
items are partly a function of the criticalness 
with which Ss respond, if criticalness is as- 
sumed to involve some intellectual ability. 

When the six measures were pooled in a 
“general acquiescence” measure, the K-R 20 
reliabilities were .73 for males and .70 for fe- 
males. On over-all reliability alone, therefore, 
one could hypothesize a general acquiescence 
factor, whereas finer-grain analysis would 
show independent sources of reliable variance. 


Discussion 


If the findings of this exploratory study are 
either accepted or substantiated by further 
work with other stems and content, a num- 
ber of important consequences follow. Studies 
seeking to correct personality scales for acqui- 
escence should attend carefully to their ac- 
quiescence measures. The same caution is 
necessary when investigators set out to find 
the characteristics of the “acquiescent per- 
sonality.” It is entirely possible that many 
acquiescences exist. Some of these could re- 
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flect group factors. There might be, for ex- 
ample, relatively high correlations between 
scales defined by “often,” “usually,” “at 
times,” and “most of the time.” If such a 
“temporal” set exists, it could have interest- 
ing personality correlates. To search for a 
single set of correlates of acquiescence, how- 
ever, would be to disregard the complexity of 
test-taking behavior, and to lead to an over- 
simplified view of human nature. 

When a scale contains a variety of item 
stems, each eliciting individual differences 1n 
interpretation, the result is to lower the in- 
ternal consistency of the measure. Thus, when 
different item wordings are mixed in a single 
scale, a certain amount of “noise,” as opposed 
to “information,” is to be expected. To make 
items homogeneous in style, on the other 
hand, is to inflate the internal consistency of 
the scale. Such cases occur and are not lim- 
ited to true-false tests. Edwards (1954), for 
example, has worded the bulk of the items 
on his forced-choice Personality Preference 
Schedule in terms of “liking” something. The 
exceptions are all items on the Abasement 
and the majority on the Aggression scales. 
When both items in a forced-choice pair 10- 
volve “liking,” the set is nullified, but when 
an abasement item is always paired with a 
“liking” item, the set could operate. It seems 
reasonable to expect that new forced-choice 
personality tests will appear in the fe 
consequently, it is to be hoped that strict a x 
tention is paid to item wording before inter 
pretation of item content is attempted. 


Summary 


Six 20-item true-false scales were con- 
structed to test the hypothesis that responses 
on personality tests are in part a function o 
the subject’s interpretation of the wording 9 
items. Five of the scales were homogeneous 
for item stems: “I often,” “I wish,” “I a 
had,” “I never,” and “I like.” The sixth sca s 
contained varied content worded in the man 
ner of California F test items. -A 

The measures showed moderate reliability 
when given to groups of male and female 
university students. Intercorrelations among 
scales generally fell below the values to r 
expected if the reliability of the individua 
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Measures were due solely to general acquies- 
cence. There appear to be different types of 
acquiescent behavior, determined in part by 
the interpretation subjects make of key words 
1n items, 

It was concluded that studies of “acquies- 
cence” in tests, and investigations of the “ac- 
quiescent Personality,” require considerable 
attention to item wording before results can 
be accepted as definitive. 


Received May 20, 1958. 
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THE STABILITY OF TAT FANTASY AND 
STIMULUS AMBIGUITY? 


JEROME KAGAN 
Fels Research Institute, Yellow Springs, Ohio 


Although psychologists use fantasy re- 
sponses for both research and diagnostic pur- 
poses, information on the long-term stabil- 
ity and validity of fantasy variables is still 
needed. This report deals with the long-term 
stability of certain TAT content categories in 
relation to the ambiguity or “content pull” of 
the fantasy stimulus. Ambiguity is defined in 
terms of the number of alternative interpreta- 
tions given to a stimulus and as ambiguity 
decreases one expects several popular or 
modal interpretations to be elicited by the 
stimulus. When a fantasy stimulus is highly 
ambiguous, individual differences in thematic 
content may be due, in part, to differences in 
(a) the interpretation of ambiguous cues on 
the stimulus and (b) the subject’s cognitive 
approach to the task (Schwartz & Kates, 
1957; Weisskopf, 1950; Weisskopf-Joelson & 
Lynn, 1953). For example, the thematic con- 
tent produced to Cards 11 or 19 of the TAT 
series, which are highly ambiguous, seems de- 
pendent on both the subject’s hypothesis as 
to the nature of the “object” on the picture 
and his cognitive style in interpreting an am- 
biguous stimulus. Some people become de- 
scriptive of concrete details of the stimulus 
when asked to interpret an ambiguous pic- 
ture, while others, perhaps less anxious, proj- 
ect motives and feelings into their themes 
(Weisskopf-Joelson & Lynn, 1953). 

However, when the stimulus is structured 
to suggest a specific motive or conflict, one 
may assume that one of the subject’s hypothe- 
ses for interpretation included the motive 


1 This research was supported by a research grant 
(M-1260) from the National Institute of Mental 
Health of the National Institutes of Health, United 
States Public Health Service. The author wishes to 
thank Howard A. Moss for his comments on the 


manuscript. 


illustrated. Thus, absence of a certain motive 
in a theme told to a stimulus suggests that 
content is apt to be a more valid measure of 
conflict than absence of this content to an 
ambiguous stimulus. For example, absence of 
an aggressive theme to a picture with no cues 
for aggression could indicate either (a) low 
aggressive motivation, (b) strong aggression 
anxiety which led to inhibition of an a8 
gressive theme, or (c) a descriptive and non- 
thematic approach to ambiguous stimuli. 
However, when a subject does not report an 
aggressive theme to a picture possessing a 
gressive cues, it seems most plausible to ac 
count for this behavior in terms of anxiety 
over aggressive motives. Thus, if conflict pr 
mains stable over time, occurrence Or ao 
occurrence of thematic content to a : 
which suggest conflictful motives is apt to A 
more reliable than the interpretations of an 
biguous stimuli. Recent research suggests pees 
fantasy interpretations of stimuli which a) 
gest specific motives are also better predic a 
of related classes of overt behavior than 1a : 
tasy responses to stimuli which are ae ge 
for these motive areas (Crandall, 1955; ËP 
stein & Smith, 1956; Kagan, 1956; Koe a 
Moss, 1959; E. J. Murray, 1958; E. 
1956; Weisskopf, 1950; Weisskopf-Joelso”®: 
Asher, Albrecht, & Hoffman, 1957). ir 
The present research investigated the r s 
tionship between the stability of TAT c : 
tent and stimulus ambiguity for a group ie 
middle-class children who are part of the Fe 
longitudinal research population. 


Method 


From the files of the Institute, 86 Lon 
(Ss) were selected (44 boys and 42 era 
for whom three sets of seven card TAT pro 
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E were available. The median ages of ad- 

ce were 8-9, 11-6, and 14-6. The 

tay ee administered from the H. A. Mur- 

BM 43) series were 1, 5, 14, 17 BM, 3 
» 6 BM, and 3 GF. 


TAT Content 


Pkn protocols were scored for a va- 

of int themes, but many of the themes were 

with aoe occurrence and this report deals 

ave: e following content categories which 
een classified as needs or press. 


tivo Pendency: (n-Dep). The central figure ac- 
i Seeks aid, support, guidance, or encouragement 
mm other figures, 
given wrturance: (p-Nurt). The central figure is 
noth Ove, advice, a gift, or encouragement from 
he ¢ er figure and the nurturance was unsolicited by 
entral figure. 
of tha hevement: (n-Ach). The behavior or thoughts 
wip „Sentral figure are concerned with competition 
scored Standard of excellence. This content was 
(Atkin cording to the definition of McClelland 
t inson, Clark, & Lowell, 1953) and is comparable 
eir score of Ach Th. 
Ph «Physical aggression by the central figure: (n- 
Bhys The central figure executes or contemplates 
e. p aggression, e.g., to fight, kill, injure. } 
(nnd ae hysical aggression by the central figure: 
Cutes Agg). The central figure contemplates or hese 
bein, Nonphysical aggression such as teasing; steali g 
ag 8 angry, etc. This category includes nonphysica 
Bression at all figures except parents. j 
cent Nonphysical aggression to the parents fe a 
een figure: (n-Ind Agg Par). The central ene 
Ward o tee or executes nonphysical aggression 
the mother, father, or both parents. 
e Phy sical aggression directed at the Go a 
jureq (p-Ph Agg). The central figure is killed, 
ed, or Physically attacked by another person. 
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h. Nonphysical aggression directed at the central 
figure: (p-Ind Agg). The central figure is teased, re- 
jected, or robbed by figures other than the parents. 


Percentages of agreement between two in- 
dependent raters scoring the protocols was 
88%. The central figures were designated be- 
fore the scoring in the following manner. For 
Cards 1, 17 BM, 3 BM, 3 GF, and 14 the 
single figure on the card was the central fig- 
ure. For Card 5 the woman was the central 
figure unless the woman was designated as a 
mother and her child was a major figure in 
the plot. In these cases the child was the cen- 
tral figure. For Card 6 BM the young man 
was designated as the central figure. 


Results 
Age and Sex Differences in TAT Content 


Table 1 shows the percentage of boys and 
girls reporting one or more of the eight con- 
tent categories for each of the three protocols. 

There were only two marked age changes 
in frequency of the various contents. In com- 
paring frequency of occurrence for Protocol 3 
versus Protocol 1, achievement themes showed 
a significant increase with age for both sexes 
(p < .01), and the girls showed an increase 
in physical aggression by the central figure 
(p < .01). All p values are for two tails. 
There were two significant sex differences in 
content. For both Protocols 1 and 2 the oc- 
currence of both dependent and nurturant 
themes were more frequent for girls than for 
boys ($ < .02 for both contents). In con- 
trast with earlier findings on the content of 


Table 1 
Percentage Reporting TAT Themes to Each of Three Protocols 
er 
Protocol 1 Protocol 2 Protocol 3 
—— ae . 
Content Boys Girls Boys Girls Boys Gii 
nten 

2.9* 13.6 38.1* 20.5 35.7 

PNG igo por 15.9 40.5* 205 26.2 
Ria wo 357 477 45.2 soi e 
m-Ph A, 273 143 318 405 27.3 405 
n-Ind ee 45.5 28.6 45.5 cp 7 he 40.5 
n-Ind AEE Par 29.5 a 27 16.7 207 a 
ied ee an 143 318 35.7 159 31.0 


* i P 
Sex differences significant at p < .02 for two tails. 
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doll play fantasy in preschool children, there 
were no marked sex differences in incidence 
of aggressive fantasy (Bach, 1945; Sears, 
1951; Yarrow, 1948). 


Stability of TAT Content 


Since the average occurrence of each of the 
content categories for any one protocol was 
one, phi coefficients were computed to assess 
the stability of the eight content categories 
over the three administrations. There were no 
marked sex differences with respect to the de- 
gree of stability of any of the content cate- 
gories and the sexes were pooled in comput- 
ing the final phi coefficients. Table 2 shows 
the values of phi and associated two-tailed 
significance values. 

It is apparent that, with two exceptions, the 
content dimensions were not very stable over 
time.” The two categories which showed a low 
but significant degree of stability were physi- 
cal aggression by the hero and need achieve- 
ment. Degree of stability was not simply re- 
lated to frequency of occurrence, for n-Ph Agg 
was not one of the more frequently occurring 
themes. Although p-Ind Agg showed a signifi- 
cant phi coefficient between Protocols 2 and 3 


?In order to determine if the stability of aggres- 
sive themes would change if the categories were 
pooled, phi coefficients were computed for the com- 
bined category of all aggressive themes by the cen- 
tral figure (Categories d, e, f) and for all aggressive 
themes directed at the central figure (Categories g, 
h). The stability of these two combined categories 
was not Statistically significant and did not differ 
from the stability of any of the individual aggression 
categories except for physical aggression by the cen- 
tral figure. 


Kagan 


Table 2 


Reliability of Occurrence of TAT Themes Over ‘Three 
Administrations (Phi Coefficients) 


Average 

Content P1-P2 P2-P3 Pi-P3 Phi 
n-Dep +.18 +.01 +.01 07 
p-Nurt +.01 +.03 +.10 05 
n-Ach +.32* +16 +.22 .23 
n-Ph Agg +.34* 4.34" +.15 .28 
n-Ind Agg +.18 16 17 A 
n-Ind Agg Par +.01 +.11 +-.20 lL 
p-Ph Agg +.09 +14 +.19 14 
p-Ind Agg +.01 +.27* = -+.02 10 


* p <.01 for two tails. 


the other two phi coefficients were nonsignifi- 
cant and this category was not as stable as 
n-Ach or n-Ph Agg. An analysis of the dis- 
tribution of all eight contents to the seve? 
TAT stimuli revealed that n-Ach and n-Ph 
Agg themes each occurred with a high de- 
gree of frequency to a specific picture which 
seemed suggestive of these contents. Physical 
aggression by the central figure tended to 
occur to Card 3 BM, which illustrates 4 
slouched figure and an object often seen as 4 
gun. Achievement themes occurred to Cards 
1 (boy with violin) and 17 BM (man son 
rope), both of which suggest competition 
and/or a desire to accomplish a task or iM- 
prove at a skill. Occurrence of the ena 
six contents, which were less stable, tende a 
be more evenly distributed over many © the 
TAT pictures. That is, there was no one 
stimulus which was highly suggestive of any 


Table 3 


Percentage of Entire Group Reporting TAT Themes on One or More of the Three Administrations 


Card 
Content 1 17BM 3BM 3GF 14 6BM 5 
n-Dep 12.7 12.7 16.3 16.3 11.6 16.3 ia 
p-Nurt 11.6 26.7 29.0 20.9 5.8 20.9 a 
n-Ach 59.3 44.2 3.4 0.0 22.0 9.3 oe 
n-Ph Agg 0.0 6.8 44.2 4.7 5.8 zz s 
n-Ind Agg 3.4 12.7 23.2 20.9 20.9 ze a 
n-Ind Agg Par 13.6 12 12.7 3.4 18.6 ae ne 
p-Ph Agg 0.0 15.1 23.2 24.4 10.5 24 es 
6 34 > 

p-Ind Agg 2.4 8.2 15.1 18. 
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Table 4 


ie to Which the Occurrence of the TAT Themes 
+ACTOSS TAT Stimuli Deviated From a Random 
Distribution (Values of Cochran’s Q) 


Average 
P-1 P-2 P-3 Q 

eg 10.5 5.2 20.2 120 
mai 223 116 62 133 
Bh 110.7* 81.6 924* 949 
Pike 35.2" sist 93.1% 69.9 
Race 234* 117 100 15.0 
nd Agg Par 25.74 60 19.2 170 
Ph Agg 36.3* 274* 29.3* 31.0 
D-Ind Agg 96 108  30.0* 16.8 


* 

ig a value of i ired for 

signi of Q equal to or greater than 22.5 is requi 
ficance at the .001 level of confidence for two tails. 


r these six contents. Table 3 shows the dis- 
ribution of each of the eight content cate- 
Bories to the seven TAT stimuli. The num- 
“ts refer to the percentage of the entire 
ey reporting the specific content on at 
ast one of the three administrations. 
$ lable 3 reveals that the only stimuli to 
Vhich at least 40% of the group told the 
“ame theme were Cards 3 BM (n-Ph Ags), 
(n-Ach), and 17 BM (n-Ach). In order to 


test the statistical significance of the tend- 


fo i i d achievement 
physical aggression and a 
a ly distributed over 


themes to be nonrandom 
€ seven TAT cards, Cochran’s Q test was 
applied to the data for each of the three pro- 
ocols. This statistic tests the degree to which 
the pattern of occurrence of a fantasy theme 
O the seven TAT stimuli deviated from a 
random distribution, and the distribution of 
© approximates that of chi square. The Rene 
ÈS referred to Cochran (1950) and Siege 
(1956) for: a summary of this technique. 
Table 4 shows the values of Q for each pe 
rent category to each of the three protocols. 
he larger the value of Q the less random 
Was the distribution of the theme to the seven 
Cards. A 
he largest values of Q occurred for eas 
Ment and physical aggression themes an 
Was significant at the .001 level for these two 
Contents for all three protocols. Furthermore; 
rank order correlation between the ane 
äge value of phi (measure of stability) a” 
€ average value of Q over the three ad- 
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ministrations was +.81 (p < .05). This indi- 
cates that even for the contents which did not 
show significant values of phi, the degree of 
stability of a theme was facilitated by the 
presence of a stimulus which had some tend- 
ency to elicit the content in question. One im- 
plication of these findings is that when a 
fantasy motive or press occurs to a stimulus 
which does not suggest that content, the long- 
term stability of that fantasy variable tends 


to be very low. 


Discussion 


These data suggest that the long-term sta- 
bility of a fantasy motive or press is depend- 
ent on the ambiguity of the fantasy stimulus 
for that content. If one assumes that these 
content variables have some relation to com- 
parable motive and response tendencies in 
other behavioral contexts, then one implica- 
tion of this finding is that a theme told to an 
ambiguous stimulus may be a less sensitive 
indicator of a motivational predisposition than 
a theme told to a nonambiguous stimulus. 
Several investigations support this hypothesis. 
Kagan (1956) found that boys who were 
rated as extremely nonaggressive were less apt 
to tell aggressive stories to pictures which 
suggested boys fighting than boys who were 
rated as extremely aggressive. The incidence 
of aggressive stories to ambiguous pictures 
did not differentiate these two groups. It was 
assumed that the low aggression boys were 
anxious over expression of aggression both in 
fantasy and overt behavior and inhibited this 
class of response in both situations. E. J. 
Murray (1958) found that occurrence of 
sleep themes to pictures which were am- 
biguous for this theme did not differentiate 
sleep deprived from nondeprived Ss, The 
stimulus which suggested sleep activity did 
differentiate the two groups. The sleep de- 
prived Ss were less likely to tell sleep themes 
to the nonambiguous stimulus, and it was as- 
sumed that sleep deprivation led to anxiety 
over the thought of sleep and produced an 
inhibition of sleep related fantasy, Epstein 
and Smith (1956) found similar results using 
hunger motivation as the experimental vari- 
able. Incidence of hunger themes to pictures 
ambiguous for this content did not differenti. 


eee 
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ate hungry from nonhungry Ss. However, to 
the stimulus which suggested a hunger theme, 
the hungry men were less apt than the non- 
hungry Ss to report this content. The authors 
suggested, as did Kagan (1956) and E. J. 
Murray (1958), that when a fantasy stimu- 
lus suggests a content which is associated 
with anxiety, the S tends to inhibit a theme 
which includes the anxious material. This rea- 
soning is based on the interaction of the 
gradients of approach and avoidance pos- 
tulated by Miller (1948). Aggression and 
achievement are both motives which are po- 
tential sources of anxiety (Kagan, 1956; 
Kagan & Moss, 1959; McClelland et al., 
1953; Weisskopf-Joelson et al., 1957), and 
thus the present results are consistent with 
previous theorizing and research. 

One implication of these studies is that a 
fantasy response to a stimulus which suggests 
a conflictful motive may be a more sensitive 
indicator of anxiety or conflict than the re- 
sponse to a stimulus which is ambiguous for 
that content. Lazarus (1953) has argued for 
the inclusion of nonambiguous stimuli in pro- 
jective instruments as a means of assessing 
conflict and type of defense to conflictful mo- 
tives. However, there has been a long stand- 
ing tendency to use projective tests which 
contained ambiguous stimuli because they 
were assumed to elicit the primary preoccu- 
pations of the S. With the recent emphasis on 
the importance of the defensive organization 
of the individual and the ways in which he 
can repress, deny, and distort anxiety arous- 
ing motives it seems profitable to use inter- 
pretations of nonambiguous stimuli as indices 
of conflict and associated defensive responses. 
The present results indicate that interpreta- 
tions of nonambiguous stimuli are more stable 
over time and suggest that psychologists 
evaluating fantasy should take into account 
the specific stimulus to which the fantasy 


appears. 
Summary 


The long-term stability of eight fantasy 
he TAT was assessed on a 
group of 86 children with TAT cards ad- 
ministered at ages 8-9, 11-6, 14-6. The eight 
contents were n-Dependence, p-Nurturance, 


categories on tl 


Jerome Kagan 


n-Achievement, n-Physical Aggression, n-In- 
direct Aggression, n-Indirect Aggression to 
Parents, p-Physical Aggression, and p-Indi- 
rect Aggression. Of the eight contents, only 
physical aggression by the hero and achieve- 
ment themes showed better than chance sta- 
bility over the three administrations. Analysis 
of the pictures to which these occurred re- 
vealed that these two contents occurred to 
pictures which were suggestive of these con- 
tents. The remaining content categories tended 
to occur with equal frequency to several of 
the cards and were not frequently elicited by 
any one stimulus. Thus, the stability of the 
content was related to the presence of 4 
stimulus which had a tendency to elicit the 
theme in question. The sensitivity of non- 
ambiguous stimuli in assessing degree of Con- 
flict and defensive reactions was discussed. 


Received May 21, 1958. 
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A STATISTICAL NOTE ON RACIAL DIFFERENCES 
IN THE PROGRESSIVE MATRICES 


ARTHUR R. JENSEN 1 


Institute of Psychiatry, University of London 


An article appearing in this Journal (Sper- 
razzo & Wilkins, 1958) presented an analysis 
of variance of scores on Raven’s Progressive 
Matrices. The main variables in the analysis 
were age, sex, race, and socioeconomic (S-E) 
status (as judged from father’s occupation). 
Variance estimates attributable to age, race, 
and S-E status were found to be significant 
beyond the .01 level. However, the fact that 
there was a significant first-order interaction 
between race and S-E status and a significant 
third-order interaction between race, sex, age, 
and S-E status led the authors to conclude 
the following: 


It is apparent from the significant race by socio- 
economic status interaction and the third-order in- 
teraction that a restriction on the interpretation of 
the race difference found is necessary. The measured 
differences in scores between races are related to the 
age, sex, and socioeconomic status of the Ss. The re- 
sults cannot be interpreted, therefore, as showing dif- 
ferences in intelligence between the races tested here. 
The differences found seem to depend upon varia- 
tions of the nonrace factors (Sperrazzo & Wilkins, 
1958, p. 37). 


This is an incorrect interpretation of the 
analysis and, therefore, from a statistical 
standpoint, an unwarranted conclusion. The 
most stringent test of the significance of the 
main effects is obtained in this case, not by 
using the residual (or within group) variance 
as the error term, but by including all the in- 
teractions (in addition to the within group 
variance) in the error term. This has been 
done in Table 1. 

It may be concluded that in spite of the in- 
teractions between the variables (race, S-E 
status, age, sex), the race difference is highly 
significant statistically. The approximate per- 
centage of the total variance in Matrices 


1 USPHS Research Fellow of the National Institute 
of Mental Health. 


scores in this study attributable to age is 
23%; to race, 10%; to S-E status, 5%; and 
to sex, 0%. 

It should also be pointed out that while the 
Matrices are regarded as a test of general in- 
telligence, with a G saturation of about 80 
(Raven, 1947), the term “intelligence” in the 
above quotation would seem to call for m- 
verted commas in view of the unusually low 
correlations found in this study between the 
Matrices and three other tests of intelligence. 


Table 1 
Analysis of Variance of Progressive Matrices A 
Source of Sums of Mean 
Variation Squares df Variance 
Total 20,759.96 479 % 
Age 4,772.60 4 1,193.15 
Sex 80.03 1 80.03 
Race 2,116.80 1 2,116.80 10.54" 
Socioeconomic 1,056.52 2 528.26 
Residual 12,734.01 471 27.04 
(error) 
*p <.001. 
: e 
Of course, the actual magnitude of ms 
racial difference may be very small, ei 


though the difference is highly significant 3 
tistically. An analysis of variance perionmi 
on the three socioeconomic groups separati 
in addition to presenting the mean scores i 
each race within each S-E group, would giv! 
a more complete and meaningful picture. 


Received June 3, 1958. 
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RACIAL DIFFERENCES ON PROGRESSIVE 


MATRICES 


GERALD SPERRAZZO 
University of Ottawa 


anp WALTER L. WILKINS 
St. Louis University 


The additional analyses suggested by Jen- 
Sen have been undertaken, and the results are 
Shown in Table 1. Three analyses of EA 
are Presented by socioeconomic status of 4 n 

ildren, this status being based only ef 
saPation of the father. The three levels o 
Such status are represented as fol lor 
(A): Professional or sempre 
(B): skilled, semiskilled, or ataei ai 
(c * service, unskilled, or labor. The r be- 
n Table 1 show a significant difference 


ces (Negro and white) in two 

are the raa aE status interactions 
reported earlier. Mean score for each race = 
ch of these three levels is shown in Table 
The authors recognize that the index of 
socioeconomic status used for both white and 
Negro groups does not equate the samples 
the two races on socioeconomic level as 
aS concept is defined in conventional treat- 
ments of social classes. Rather, the index was 
intended to provide an ordering within each 


Table 1 


es From 480 Children on C 


‘olored Progressive Matrices by Socioeconomic Status 


Analysis of Variance of Scor 


es S-E (B) S-E (C) 
S-E (A) = 
= Mean 
See Mean A P 
Mean J Square Square F 
Vascos e df Square g E 
x Jon 
em 7.44 16,71* 415.20  14.68* 
7 * 40 
Total 159 437.58 17.9%" 1,452.00 59.58* 105.62 3.73 
Age 4 980.10 40.20 90 — 198.02 7.00* 
Race 1 560 ae 24.37 28,28 
En 133 24.38 
“rror 3 x 
* 01 level of confidence. É 
moranna race that would parallel the order obtained 
Table 2 lored from more precise indices. The assertion that 
7 hildren on Colo American Negro class structure is not directly 


Mean Scores of Negro and White C. il nic Status 


ji 01 
Togressive Matrices by Socioec S 
S-E 
s-E (B)” 
a Ps 7 21.13 
218 19.51 


White 26.41 76 


i ional. 
: geienen sent cal. 
© Ser Cd Semis! F 2 
Service, unskilled, labore". 


comparable to that of American white has 
convincing support from social science litera- 
ture. Therefore, it is not surprising that “race 
differences” in “intelligence” test scores are 
found with a test that is sensitive to varia- 
tions in socioeconomic background. What is 
more surprising is that a relatively nonverbal 
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performance test is demonstrably sensitive to 
differences in socioeconomic level. 

The usefulness of the S-E index even to 
rank-order Negro class structure is thrown 
into doubt by an examination of mean differ- 
ences by S-E index, race, and sex. For white 
males and females, there is a difference of 
over five points in mean test score between 
the top and bottom S-E categories (P < .01). 
Although there is a mean difference of 3.68 
between top and bottom S-E category for Ne- 
gro females (P < .01), there are no demon- 
strated differences among the categories for 
Negro males (P > .10). One may conjecture 
after the fact that, for example, service oc- 
cupations (S-E Level C) are functionally 
equivalent to or higher among Negroes than 
semiskilled or clerical occupations (S-E Level 


Gerald Sperrazzo and Walter L. Wilkins 


B). The differences between Negro males and 
females in the ordering of test scores for the 
three S-E groups might reflect a sex differ- 
ence in accuracy of reporting father’s occupa- 
tion or, more precisely, a sex difference in 
willingness to report a socially less acceptable 
family arrangement. 

The question raised by Jensen leads to 
speculation on several fronts, and we wish to 
thank him for stimulating this re-examination. 
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DEFENSIVENESS, INSIGHT, AND THE K SCALE 


EWART E. SMITH! 


Fels Group Dynamics Center, 


mene ensiveness is a popular, but difficult to 
have Om Page and Markowitz (1955) 
vidual ned it as follows: “The defensive in- 
ascribe is described as one who fails to 
ally sinha himself characteristics of a gener- 
sH alid but socially unacceptable nature.” 
ory a (1952) has pointed out in his the- 
eral sa and defense, there are two gen- 
Olds eories of pathology. The first theory 
block a pathology is due to frustration, oF 
is i needs, and the second that pathology 
occu e to threat. As Hogan defines it, “Threat 
as bet When the self perceives its experiences 
self Sng inconsistent with the structure of the 
in on Po is then necessary for the individual, 
tort er to maintain his perceived self, to dis- 
whith Pee particularly that experience 
que is contrary to his self image. Conse- 
als ntly, we would expect defensive individu- 
to be low in self insight. 
whi ia scale (Meehl & Hathaway, 1948), 
fen ch is generally considered a measure of de- 
Siveness (McKinley, Hathaway, & Meehl, 
ee Page & Markowitz, 1955; Sarason, 
ise) Grayson & Olinger, 1957; Handley, 
sc at because it detects abnormals who de- 
y tibed themselves as normal on the MMPI, 
Was used as a defensiveness measure M the 
Present investigation. 
fe 5e hypothesis tested was: The more i 
nsive the individual, the less insight he wi 
ee Unexpected results necessitated a rae 
in 3 designed to retest this hypothesis aiu 
s addition, to test the hypothesis that the 
Cale is a measure of defensiveness- 


Method 


Subjects and Task 
the subjects (Ss) 


we In the first investigation 

ere 45 male and 45 female summer school 
ae author wishes to thank Jacqueline Good- 
mads and Jacob Schonfield for their helpful com- 
ents and criticisms. 


University of Delaware 


students at the University of Delaware, who 
participated in nine male and nine female 
five-person groups. The task was to solve, by 
means of a 25-minute discussion, an interest- 
ing but difficult industrial personnel problem 
(Maier, 1950). 

In the second investigation, the Ss were 11 
male and 3 female first-line supervisors (fore- 
men), and 12 male second-line supervisors in 
a large eastern corporation. The Ss were par- 
ticipating in a five-day management training 
course in which the interpersonal factors in 
management were stressed through the use 
of role-playing, feedback sessions, etc. Two 
training groups were used, separated in time, 
one group for first-level and one for second- 


level supervisors. 


Measures 

In the first investigation, the K scale was 
used to measure defensiveness. Insight was 
measured by having each S indicate for three 
negative roles (aggressing, blocking, withdraw- 
ing) who (including himself) took the roles. 
An insight score was computed for each S 
by determining the discrepancy (ignoring the 
sign) between the number of roles he credited 
to himself, and the average number of roles 
credited to him by the group. 

In the second investigation, the K scale 
was again administered, as was the role list 
expanded to include four negative roles, In 
addition, each S rated each group member on 
defensive behavior. Defensiveness was defined 
on the rating form as follows: 

By defensiveness, we mea 
son o become upset if eo eee 
the tendency to deny having made an error or mis 


take when it is obvious that we have 
i made is- 
take, the avoidance of evaluations which Hii Be 


critical, etc. 


275 


276 
Table 1 
Number of Ss Accurate or Inaccurate on 
Negative Roles by K Scores 
Accu- Inaccu- 
rate rate ‘Totals 

Above mean on K scale 19 25 Ad 
Below mean on K scale 9 37 46 
Total 28 62 90 

x?= 5.85* 

Results * 


The First Investigation 


The K scale scores were broken at the 
mean, and the insight scores were dichoto- 
mized into completely accurate or not com- 
pletely accurate categories. We see from 
Table 1 that there is a significant relation- 
ship between defensiveness, as measured by 
the K scale, and insight, with the more de- 
fensive individuals having the most insight. 
This result is contrary to the hypothesis. 


The Second Investigation 


The rank order correlation between the K 
scale and insight on negative role behavior is 
—.52**, which cross-validates the relation- 
ship found between the K scale and insight 
in the first investigation. The rank order cor- 
relation between the defensiveness rating and 
insight on negative role behavior is +.60**, 
which supports the original hypothesis. 

The reliability of the defensiveness rating 
scores, computed for each S by averaging the 
ratings of the other group members, was com- 
puted by correlating the mean ratings of the 
odd numbered and even numbered raters. The 
resulting corrected reliability correlation is 
91. The corrected reliability coefficient on 
the average negative role scores used for com- 
puting the insight scores was .87. Finally, we 
find that the correlation between the K scale 
and the defensiveness ratings is —.39*. 


Discussion and Conclusions 


At this point, our results are both persist- 
ent and contradictory. Our two measures of 

2 Statistical significance at the .05 level has been 
indicated by a single asterisk; at the .01 level by a 
double asterisk. 


Ewart E. Smith 


defensiveness are negatively correlated. The 
K scale was carefully constructed empiri- 
cally, and cross-validated. The defensiveness 
behavioral ratings were made by combining 
the judgments of 11 or more Ss, each of whom 
had had 40 hours of observation on which to 
base their ratings. 

It is possible to rationalize the data, how- 
ever, if it is recalled that the K scale items 
are essentially a list of negative behaviors 
which the S is asked to either accept or deny 
as applying to himself. Consequently, when 
the original K scale standardization Ss, who 
were abnormal on such criteria as institu- 
tionalization, obtained high scores on the 
scale (i.e., denied abnormal behavior) it was 
clear that they were being defensive. How- 
ever, in the two investigations reported here, 
we were dealing with normal Ss and foun 
that normal Ss who denied, on the K scale, 
considerable abnormal behavior had good in- 
sight and were not seen as behaving defen- 
sively. On the other hand, our normal popt- 
lation Ss, who admitted a large number ° 
negative traits on the K scale, had poor ey 
sight and behaved defensively, suggesting 
some degree of insecurity or neuroticism Sa 
their part. In sum, it is argued here that He 
is defensive for abnormal population Ss to at 
tain high K scale scores but a sign of heal el 
for normal populations Ss. This explana 
can be supported by several other invest ee 
tions. Wheeler, Little, and Lehner (1951) es 
their factor analysis of the MMPI presea 
evidence for an interpretation of the K scale 
as a measure of ego defenses. Sarason (1956), 
using the K scale as a measure of defensin 
ness, found that those scoring high in defe 3 
siveness were significantly superior OM t í 
ACE and tended to be superior in 8ta g 
point average. These results were interprete 
as due to the adverse effect on performance © 
the self-criticism of low Ks. Sweetland aa 
Quay (1953) summarize several bits of i 
formation which indicate that normal 


: z o- 
scores may indicate social security and H 
tional adjustment. They conclude: ae can 


gestion was made that K scores, when 
normal ranges, may possibly be a measure ie 
personality integration.” In view of the oe 
dence, as seen in Wheeler, Little, and Lehner 3 
data, that the mean K scores of normal pop 


Defensiveness, Insight, and the K Scale 


ae groups are higher than those of abnor- 
al Populations, Sweetland and Quay might 
priten have concluded that high K scores on 
ormal populations are a measure of person- 
ality integration, 
su n conclusion, it is believed that the data 
vide ig the hypothesis that defensive indi- 
indi als are low in insight. Secondly, the data 
as Icates that the K scale should not be used 
a measure of defensiveness with normal 
Populations. In addition, these results sug- 
oF that greater caution should be exercised 
ure e intepretation of clinically derived meas- 
S used with normal populations.* 


Summary 


ti Two investigations were made of the rela- 
°nship between defensiveness and insight. 
he hypothesis tested was that defensive in- 
‘viduals would be low in insight. In the first 
Be Oratory investigation), using the K scale 
the MMPI as a measure of defensiveness, 

S Significant relationship was found but was 
not in the predicted direction. ae 
Tn a second (field investigation), the origi- 


hypothesis was supported by a high posi- 
Wve relationship between defensive behavior 
jatings and insight. The K scale again corre- 
ated in the wrong direction with insight and 


was negatively related to the defensive be- 


avior rating. i 
It was concluded that: 1. Individuals who 
rience with 


3 ae, 
th This is reminiscent of our early expe a tae 
e Rorschach, when we were astounded at t l 
et of our friends and colleagues who, by cli 
eria, were schizophrenic. 
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behave defensively in groups are low in in- 
sight. 2. The K scale is not an adequate 
measure of defensiveness on normal popula- 
tions. 3. Greater caution should be exercised 
in the use of clinically derived measures on 


normal populations. 


Received November 17, 1958. 
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MANIFEST ANXIETY, INTELLIGENCE, AND 
COLLEGE GRADES! 


CHARLES D. SPIELBERGER axb WILLIAM G. KATZENMEYER 


Duke University 


Several studies recently reported in this jour- 
nal have examined the relationship between the 
Taylor Manifest Anxiety Scale (MAS) and col- 
lege grade-point averages (GPAs). Matarazzo 
et al. and Klugh and Bendix found nonsignificant 
MAS-GPA correlations of —.08 and .01, respec- 
tively; Sarason reported that analysis of variance 
failed to reveal any changes in GPA as a func- 
tion of MAS score. Although ACE scores were 
available to all of these Zs, only Klugh and 
Bendig took intelligence into account in evaluat- 
ing the relationship between MAS scores and 
grades, and none considered the possibility that 
anxiety might be differentially related to grades 
for students with differing intellectual abilities. 

The moderately high correlations which have 
been consistently reported between various meas- 
ures of intelligence and college grades would seem 
to indicate that poor academic performance was 
primarily determined by limited ability while 
good grades were largely determined by superior 
intellectual endowment. Thus, personality or mo- 
tivational variables might be most likely to in- 
fluence the academic performance of students 
with average ability. The purpose of the present 
study was to examine additional evidence on the 
relationship between MAS scores and GPAs and 
to determine whether this relationship varied as 
a function of the intellectual level of the student. 

The MAS was administered to all students in 
the introductory psychology course at Duke Uni- 


1 An extended report of this study may be ob- 
tained without charge from Charles D. Spielberger, 
Department of Psychology, Duke University, Dur- 
ham, North Carolina, or for a fee from the Ameri- 
can Documentation Institute. Order Document No. 
5889, remitting $1.25 for microfilm or $1.25 for 
photocopies. 


versity for six consecutive semesters, and GPAs 
were obtained for that particular semester an 
ing which a student had taken the MAS. MA 
scores, ACE scores, and GPAs were available for 
640 men. The intertest Pearson r's were i 
GPA, —.14; MAS-ACE, —.11; ACE-GPA, T 
(all significant at .01 level). Even when inte 2 
gence was not taken into account, there was 
small inverse relationship between MAS one 
and grades in the present study. In order to : 
termine whether this relationship was influencat 
by the intellectual ability of the Ss, the er 
sample was divided into the following group" ile 
the basis of ACE scores: lower 20%; m ae 
60%; and upper 20%. The MAS-GPA See 
tions for these groups were —.04, —.18, ie 
—.05, respectively. Tests‘ for linear and vee 
linear regression indicated GPAs were as 
to MAS scores for the low and high inteligen 
groups; the test for linear regression = 390, 
middle group yielded an F of 13.06 (af ge 
p < .001). Grades varied inversely with anx = 
level for the average aptitude Ss. calea eee 
appeared to be too difficult for low aptitu * ele 
dents whose poor grades were unrelated to 
MAS scores. High aptitude students tende ie 
obtain good grades regardless of their anxi 

1. ae 
yo studies may have failed to find a >a 
nificant relationship between MAS scores a 
grades for one or more of the following reaso 
(a) failure to take intelligence into og ae 
heterogeneity with respect to intelligence; ther 
clusion of both male and female Ss; (4) oe 
factors discussed in the extended report in W 
these studies are compared. 
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PROGNOSTIC FACTORS IN SCHIZOPHRENIA ' 


BETH STONE * 


State University of Iowa 


In an attempt to identify some of the prog- 
nostic factors in schizophrenia, Schofield, Hatha- 
way, Hastings, and Bell (1954) obtained follow- 
up data on schizophrenic patients and compared 
good and poor outcome groups in terms of 200 
items pertaining to their general history, previ- 
ous personality, and presenting illness. Using the 
items which discriminated best, they devised an 
cight-point prognostic scale which, when applied 
to the same subjects (Ss), identified 59% whose 
Posthospital adjustment had been good and 82% 
Whose adjustment had been poor. Since this gi 
not constitute adequate validation, an attempt 
a made in the present study to eross-validate 

eir scale, j 

The Ss were patients admitted to the Toya 
State Psychopathic Hospital with a ee ey 
Schizophrenia during the years 1929-1933. T = 
Were part of a larger group studied by Malamu $ 
and Render (1939) who made personal spe pe 
Contacts in 1938, The case histories as We. i 
Malamud’s follow-up reports on these pame 
ate still available. Even though Ss of the present 
Study were hospitalized some 5 to a Por poth 
lier than Schofield’s Ss, the treatment o) 0 
groups was quite similar, neither OUR ve 
received electroshock, insulin, oF “eo pas 
Py. Both groups were followed up at lea: 
years after their hospital admis hi 

On the basis of the same five-step R a 
Schofield et al. used (1954, P- 157), ae ital ad- 
assigned a rating in regard to his posthosp! 
any ¢ y be ob- 

An extended report of this study ve, Dept. of 
tained without charge from Beth st Ja. or 


sion. 


Sychiatry, State Univer. of Iowa, Towai tion Insti- 
Or a fee from the American Documen a Docu- 
er source, order 


tute. To obtain it from the latt 
ae No. 5890, remitting $1.25 f 
1.25 for photocopies. i oe 
. Now a graduate student at Washington U! 

Sity, St. Louis. 


or microfilm or 


iS) 


justment. Following the procedure of the Min- 
nesota investigators, Ss who fell into the four ex- 
treme outcome categories were used as criterion 
groups. Our Good outcome group consisted of 19 
Ss, and our Poor group of 64 Ss. Without the 
rater having knowledge of the outcome ratings, 
each patient was rated on the eight-point prog- 
nostic scale (Schofield et al., 1954, p. 163). In- 
tra- and interrater reliability checks yielded 91% 
agreement and 86% agreement respectively.® 

Since most of the case histories contained no 
information regarding the patient’s school deport- 
ment, it was necessary to omit Item 1 of the 
prognostic scale in the final analysis of the data. 
In view of this alteration of the scale, the pres- 
ent study is not a complete cross-validation. Ap- 
plication of this seven-point scale to the patients 
in the Good and Poor groups, using a cutting 
score of three or more points to identify cases 
with poor prognosis, resulted in identification of 
only 42% of the cases in the Good group and 
58% in the Poor group—clearly no better than 
chance identification. It should be noted that 
20% of the total sample was in the Good group 
and 68% in the Poor group. An item analysis re- 
vealed that none of the items in the scale dis- 
criminated between the two outcome groups at 
the .05 level of significance. 
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SOCIAL DESIRABILITY IN THE SENTENCE 
COMPLETION TEST' 


VITALI V. ROZYNKO 


Veterans Administration Hospital, Seattle, Washington 


This study attempted to show that: (a) the 
Social Desirability (hereafter called SD) of sen- 
tence stems is directly related to the SD of the 
responses to those stems, and (b) the tendency 
to give socially desirable responses on an inven- 
tory type test was related to a similar response 
tendency on a sentence completion test. 

Fifteen sentence stems were selected so that 
their SD scale values were relatively evenly dis- 
tributed throughout the rating range. The re- 
sponses to these stems of 50 psychiatric patients 
at Seattle VAH were then rated for SD by 50 
judges. The mean reliability coefficient for these 
ratings adjusted by the Spearman-Brown Proph- 
ecy formula was .84. 

SD scores were computed for each sentence 
stem and for each patient. These scores were 
compared with the SD scale values of the sen- 
tence stems and with the patient’s scores on the 
SD scale of the MMPI. The SD scale values of 
the sentence stems correlated .79 (p= .01) with 
the mean SD ratings of the responses to the 
stems. The patients’ sentence completion SD 
scores correlated .35 (p=.05) with their SD 
scale scores. Five groups of 10 patients each 
were selected on the basis of the height of the 
patients’ SD scale scores. These groups were then 
compared with respect to their sentence comple- 
tion SD scores by an analysis of variance design. 


1 An extended report of this study may be ob- 
tained without charge from Vitali V. Rozynko, VAH 
American Lake, Wash., or for a fee from the Ameri- 
can Documentation Institute. Order Document No. 
5891, remitting $1.25 for microfilm or $1.25 for 
photocopies. 


The differences between these groups were highly 
significant (F = 4.14, p = .01). This high F rano 
was primarily due to the mean differences pe 
tween the high SD scale scorers and the ia 
lower scoring groups. The mean difference a 
tween the two highest scoring groups yielded i 
smallest ¢, that of 2.93 (p = .01). There 5 i 
significant differences between any of the 10 
lower scoring groups. ; 
It was concluded that: (a) the SD of the hie, 
tence stem performs the function of establish! 3 
the direction of the response. A socially desi 
stem tends to evoke a socially desirable pels 
and vice versa; (b) that only patients yal 
extremely high on the SD scale tend to pere agn 
ate this response set on the sentence comp A 7 
test. Meltzoff (1951) reports similar resu é 
college undergraduates. He also fo BE 
dents placed in stress situations gave à & 4 
number of positively toned responses 0 
tence completion test than those w! 
test under nonstress conditions. These rest 5 
gest that the psychiatric patients in oe ike 
who scored high on the SD scale percelv' ned t0 
testing situation as threatening and eas ff. 
hide their “weaknesses” from the hospital s' 
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AGREEMENT AMONG RATERS ON THE MULTI- 
DIMENSIONAL SCALE FOR RATING 
PSYCHIATRIC PATIENTS ' 


C. JAMES KLETT ann JULIAN J. LASKY 


VA Central NP Research 


AA PERRE (Lorr, 1953) has provided the 
of vA criteria of behavior change in a senes 
logic Tatts cage studies of psychopharmaco- 
iia Co of acute and chronic schizo- 
one of hanger Data were collected as part of 
e rat ese studies to provide information on 
data zala consistency of the scale, and additional 
of areata the stability over time of ratings 
rom ients in a placebo group were available 
ment aes The results can serve as & supple- 

aso o findings recently reported by Stilson. 

n, Gynther, and Gertz (1958). 

are Ea morbidity score and 11 factor scores 
ese erived from 49 individual scales. Most of 
urin scales are rated from impressions gained 
ihe an evaluative interview, and the remainder 
Pati ward observations. In the VA studies, each 

ient was interviewed by a clinical team who 


a z 
ter recorded consensus judgments for this part 
f nurses and psychi- 


d items in a similar 
bers of each rat- 
dently prior to 


Pooling impressions. Of the 563, newly admitted, 
independent 


pened, 414 were rated by two 
ard team members, and 149 by three clinical 


this study may 
he VA Cen! 
Point, Md. 
ation Institute. 
$1.25 for mi- 


1 
bey extended report of 
Search without charge from t 
fe Unit, VA Hospital, Perry 
ae from the American Document 
crofiln Document No. 5892, remitting 
m or $1.25 for photocopies. 


Unit, Perry Point, Maryland 


terview and ward ratings must be combined to 
obtain morbidity and factor scores, ward and in- 
terview ratings were paired at random (within 
each set) to form a scorable set of ratings. Intra- 
class correlation was used to determine the agree- 
ment among raters. For total morbidity this co- 
efficient was .82; for the factors, as follows: A. 
Retarded depression vs. manic excitement. 72; 
B. Compliance vs. resistiveness, .65; C. Paranoid 
projection, .75; D. Activity level, .71; E. Melan- 
choly agitation, .63; F. Perceptual distortion, .80; 
G. Motor disturbances, .71; H. Submissiveness 
vs. belligerence, .73; I. Withdrawal, .71; J. Self- 
depreciation vs. grandiose expansiveness) 72; K 
Conceptual disorganization, .80. are | 

Additional ratings were available for 179 mostly 
chronic schizophrenic males before and after six 
weeks of inclusion in a lactose placebo group. The 
product-moment correlation coefficient for ‘total 
morbidity was .74. Stilson et al. (1958) reported 
a similar coefficient of .80 with chronic schizo- 
phrenic females when three weeks intervened oe 


tween ratings. 
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VALIDITIES OF WAIS SHORT FORMS IN A 
PSYCHIATRIC POPULATION? 


WILLIAM HOWARD 
Central Louisiana State Hospital 


Using the method advocated by McNemar 
(1950), Maxwell (1957) has presented the 10 
highest short form, full-scale correlations for 
combinations of two, three, four, and five WAIS 
subtests. The purpose of the present research 
was to determine similar coefficients from the 
scores of psychiatric patients. 

Ss were 186 hospitalized patients who had been 
administered the WAIS previously by a variety 
of examiners. Of this total, 70 were schizophren- 
ics, 27 were psychoneurotics, 27 had personality 
disorders, 22 were manic-depressives, and the re- 
mainder were scattered among a variety of diag- 
nostic groups. By education, the Ss ranged from 
none to a college degree, and the median was 
around nine school years. 

Short form, full-scale correlations were com- 
puted for the same combinations, five each of 
duads, triads, tetrads, and pentads that Maxwell 
found to yield the highest coefficients, Analysis 
was made separately for three age groups. 

Age group 25 to 34 produced coefficients which 
ranged from .929, the lowest duad, to .985, the 
highest pentad. For age group 35 to 44 the co- 
efficients ranged from .886 to .971. In age group 
45 to 54 the range was .913 to .985. 

The results for age group 25 to 34 are higher 
than those found by Maxwell. This discrepancy 
appeared to be due to the greater variance of the 


1An extended report of this study may be ob- 
tained without charge from William Howard, P. O. 
Box 31, Pineville, Louisiana, or for a fee from the 
American Documentation Institute. Order Document 
No. 5893, remitting $1.25 for microfilm or $1.25 for 
photocopies. 


psychiatric full-scale scores, which was signifi- 
cant at the .02 level. sam 

The present author computed short 10 : 
(same 20 combinations), full-scale correlation? 
for Wechsler’s (1955) 45 to 54 age group a 
means of McNemar’s (1950) general big 
The coefficients ranged from .909 to .977; a ie 
ings which are comparable to those observe oe 
the similar psychiatric group. There was noO bes 
nificant difference in full-scale variance bet 
the two groups at this age. 

In addition to reliable short form Hae 
correlations, pairs of subtests were found to ane 
relate highly with the verbal and perform i 
scales. None of the coefficients studied fell be 
.908. 

In general, the short form, ful 
tions were higher for the psychiatric pa 
for the standardization sample, but the di! 
appeared to result from the greater var! in the 
the patient sample. Since the correlations cluded 
two groups were comparable, it was pean he 
that any of the short forms studied co EDY 
used to estimate reliably the intelligence ° 


chiatric patients. 


full-scale 


Ja- 
full-scale corre 
tients than 
differences 
ance O 
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New Tests 


Sanders, Joseph R, Subsumed Abilities T 
adults. 1 form, 30 min. Test Booklet, wi 
PP. 25, and scoring key and tabulation sheet. Ni 
Rochelle, N, Y.: Bruce, 1957. : 

aa’ Subsumed Abilities Test (S.A.T.) is a pri 

Fon eet derivative of the Goldstein-Sheerer Co pr- 

Use, ™ Sorting Test and is available only for one 

mor Like its parent, it requires each subject to ma 3 

visas than one appropriate response to the sme 

co ual stimulus, All 30 items, of which the test $ 
maa present either four geometrical PENET ree 
i pe A ae 

H Pairs. The task is to pick out two S$! SS ie 

hree abilities— 

conceptualize—is 


vest. Age 6- 


th manual, 
ew 


complex level. 


at a si 
a simple level, the other at se 


The 


Bests a hi maaana aie 
ierarchy of six abilities: SiP » 
snblex recognition, simple abstraction, pe ales 
ote sl ization, comp!e 
Ua eS atly available and 
bles of per- 
grade 
“white 


Test. Junior High School. 
min. (one subtest is ad- 
klet; manual, 58 pP-; 
Philadelphia: Educa- 


Jastak, Joseph F. Jastak 
form. Approximately 60 
ministered orally), Test boo 
Scoring keys; and class list. 
i Test Bureau, 1958. 
The Jastak Test represents a bol n 
bine in one oe ae process indices of ppremia 
ability and personality. Ten subtests, most of the 
amiliar versions of items used in other intellige 
ests and with time limits ranging between 3 an 


d attempt to com- 


minutes, provide the basic data. Each subtest score 
can be converted to a standard score and combined 
to obtain a conventional intelligence index. The re- 
maining scores are derived from various aspects of 
the scatter of subtests. Thus, there is a capacity 
score, which, by an incompletely described process, 
uses the individual's highest subtest performance as 
a basic for estimating his capacity as distinguished 
from his current level of functioning. The intra-indi- 
vidual variance in the subtests is further utilized in 
various combinations to derive personality factors 
identified as language, reality, motivational, and psy- 
chomotor. The format is attractive and the test 
items appear designed to maintain interest. There 
seems to be a good balance of intellectual factors 
sampled. 

Considering the fact that teachers and administra- 
tors are invited to use this test, the manual has sey- 
eral defects. Much of the technical test development 
discussion is too complex to have much meaning to 
this audience and is too brief for the technically 
trained reader. No references to fuller descriptions of 
the process of analysis are cited. Samples of adequate 
size provide the basis for norms, reliability indices, 
and intercorrelational and factor studies. The reli- 
abilities of the subtests, with only few exceptions, 
range between .80 and .88. The intercorrelations be- 
tween the range scores which form the basis for each 
of the four personality scores are disquietingly low 
Though the manual contains many warnings about 
pitfalls in the administration of the test and the in- 
terpretation of the results, there are no warnings 
about the experience and training necessary to an 
evaluation of a child’s contact with reality or other 
symptoms of maladaption. i 
Me hg 2 lg instrument is claimed 

m and personality, it is sur- 
prising to find the manual completely b f ida 
tion data. Reference is E 

data. made to the author’s clinical 
experience, and several case histories are presented. 
This is weak evidence to marshal against the many 
discouraging results of other efforts to demonstrate 
the value of scatter in intelligence subtests as indices 
of personality. Not even evidence of the test’s ability 
to predict school performance is offered. Its use for 
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this latter purpose probably can be supported on the 
basis of the precedence provided by other tests of 
similar content that have been demonstrated to have 
similar value. Without validation data, the Jastak 
Test cannot be accepted as a way of obtaining the 
other inferences it purports to provide—E. S. B. 


Ford, J. S., Grimsley, G., Ruch, F. L., & Warren, 
N. D. Employee Aptitude Survey. College and 
adult, 2 forms. 55 min. 10 separate subtest book- 
lets, Form A or Form B ($2.50 per 25, $6.00 per 
100, and $25.00 per 500 for each subtest, includes 
manual and scoring stencils); a general manual, 
6 pp.; a manual, 4 pp., and scoring stencil for 
each subtest; a manual for interpretation, 11 pp. 
Los Angeles: Psychological Services, 1956. 


With few exceptions the 10 subtests in this bat- 
tery (verbal comprehension, numerical ability, visual 
pursuit, visual speed and accuracy, space visualiza- 
tion, numerical reasoning, verbal reasoning, word 
fluency, manual speed and accuracy, and symbolic 
reasoning) are familiar versions of other tests. The 
relatively high reliabilities (range .7 to .8) obtained 
for such brief tests suggest a careful item analysis. 
Because the items are incorporated into the answer 
sheet, the distribution of test materials can be ex- 
pedited. 

There are several respects in which the manuals for 
these tests are lacking. In a few instances no data on 
the correlation between alternate forms is offered. 


Psychological Test Reviews 


Information on the intercorrelation of the subtests is 
given in a form of coefficients of independence whi 
conceal as much as they reveal. The unwary reader will 
overlook the fact that this coefficient [100 (1 = 
not only reflects the variance specific to the test but 
also the variance due to errors of measurement. . 
the case of symbolic reasoning, its coefficient of in- 
dependence with respect to verbal reasoning is table 
as .64 for a sample of 90 high school students. Work- 
ing backward, it becomes apparent that the correla- 
tion between the two tests is .60, a high degree © 
overlap when one considers that their respective test- 
retest reliabilities are .69 and .79. An intercorrelation 
table is a franker and more direct way to communi- 
cate the necessary information. storable 
With the exception of word fluency, & considera 
amount of impressive validation evidence is offere 
for each test. The reported multiple correlation E 
.83 with one-year grade-point averages for a samp! $ 
of engineering students would be considered n 
tastic were it not topped by the report that a w 
validation of the regression equation in the zva 
year’s sample against a pass-fail criterion produces 
a shrinkage of only .03. Unfortunately, no cites 
of published studies are offered, and only very br 
statements of validity studies are given. P the 
If the validity studies cited are to be credited, as 
Employee Aptitude Survey may be one of the mide 
efficient test batteries we have for use with the be, 
range of subjects represented by high school and 
lege students, and by adult workers—E. S. B- 
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Brief Reports 


The Journal of Consulting Psychology will 
accept Brief Reports of research studies in 
clinical psychology for early publication with- 
out expense to the author. The procedure is 
intended to permit the publication of soundly 
designed studies of specialized interest or lim- 
ited importance which cannot now be ac- 
cepted because of lack of space. Several pages 
in each issue will be devoted to Brief Reports, 
published in the order of their receipt with- 
out respect to the dates of receipt of the regu- 
lar articles. Most Brief Reports appear in the 
first or second issue to go to press following 
their final acceptance. 


An author who wishes to submit a Brief 
Report: 


1. Sends the Brief Report, limited to one printed 
page and prepared according to the specifications 
given below. 

2. Also sends to the Editor a full report of the re- 
search study, in sufficient detail to give a clear ac- 
count of its background, procedure, results, and con- 
clusions, which will be filed with the American 
Documentation Institute to insure indefinite avail- 
abilitv. 

3. Prepares at least 100 mimeographed copies of 
the full report, which the author will send without 
charge to all who request it as long as the supply 
lasts. 

4. Agrees not to submit the full report to another 
journal of general circulation. 


Specifications 
Brief Report. The Brief Report should give 
a clear, condensed summary of the procedure 
of the study and as full an account of the re- 


sults as space permits. 
To insure that the Brief Report will be no 


longer than one printed page, its typescript, 


including all matter except the title and the 
author’s lines, must not exceed 85 lines av- 
eraging 42 characters and spaces in length. 
Set the typewriter margins for short lines 0 
42 characters, which are 3.5 inches long 
elite typing, and 4.2 inches long in pica. n 

The manuscript of the Brief Report mus 
be double spaced throughout. Except for its 
short lines, it follows the standard style s 
the 1957 revision of the APA Publica” 
Manual. Headings, tables, and references ar 
avoided or, if essential, must be counte! J 
the 85 lines. Each Brief Report must He 
companied by a footnote in the style be ak 
which is typed on a separate sheet an 
counted in the 85-line quota: 


1An extended report of this study may be et 
tained without charge from John Doe, 00 | name 
St., Prospect 6, Mass. (giving the author’s full ae 
and address), or for a fee from the American DOV 
mentation Institute. Order Document No. oto 
mitting $—— for microfilm or $—— for P 
copies. 

e- 

Extended report. Because the extended r 
port is intended for photoduplication, artyle 
not copy to be sent to a printer, its of 
should differ in several ways from sport 
other manuscripts: (a) The extended T Prof 
should be typed with single spacing fg 
economy in duplication. (b) Tables i text 
ures should be placed adjacent to the be 
which refers to them. A caption shov 
typed below each figure. (c) Footnotes Spic 
be typed at the bottom of the page 0n rae 
reference is made to them. In other 7 ape 
the full report is prepared in the style 
fied by the Publication Manual. 
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THE FACTORIAL STRUCTURE OF THE WISC 
AT AGES 7-6, 10-6, AND 13-6 ` 


JACOB COHEN 


Franklin D. Roosev 


T 
Ee ea article continues a systematic 
sampled ee of the intellectual domain as 
1949 iss the Wechsler scales (Wechsler: 
scribed the: 1958). Previous articles have de- 
er-Belle e factorial structure of the Wechs- 
Psychiatrie (W-B) for male veteran neuro- 
any atric patients (Cohen: 19528 1952b) 
(WAIS) fo Wechsler Adult Intelligence Scale 
Over a for standardization samples of adults 
in wide age range (Cohen: 1957a; 1957b). 
iting other factor-analytic studies are 
e 2a by Wechaler (1958, Ch. 8). The 
vided sia is concerned with the data pro- 
y the standardization of the Wechsler 


ntell; 
telligence Scale for Children (WISC), a 
to those 


est 
of form and content similar 
f children 


n extension 
7-6, Taken 
insight into the 
tion via the com- 
] structures 


y ny “Product of a rationale, 
Previ mparing its results W! 
hee, studies, it makes Po 
Banizati of a broad picture of 
elas Wechsler scal 
thol -8 conditions of age an 
ology, 


Subjects 


ae data analyzed were those 
levels of the total standardizat 


1 

Pay gro the Psychiatric Evaluation Project of 

ital ology Service, Veterans Administrati 

ackne Montrose, New York. The a 

t pledges the cooperation of the 

, p OSPital, and is especially indebted to 
enderson for typing the manuscript. 


Method 


of the three 
ion samples 
the 


elt Veterans Administration Hospital and 
New York University 


reported in the manual (Wechsler, 1949). The 
standardization sample was stratified at each 
age by geographic area, urban-rural residence 
and parental occupation to provide a fail 
close match with the child population dis- 
tribution of the 1940 United States census. 
The N of each age group was 200, made up 


equally of boys and girls, all of whom were 


within 14 months of their midyear (Wechsler 
1949, pp. 7-8). ? 
Analysis 

> 


The matrices of intercorrelations of the 
three age groups given in the manual (Wechs- 
ler, 1949, PP- 10-12) were separately sub- 
jected to the following analysis: * 

1. Thurstone’s complete centroid method 
was used (Thurstone, 1947, pp. 161-170) 
with communalities estimated by his Equa- 
tion 15 (Thurstone, 1947, pp. 300, 318). Since 
the absolute discrepancies between estimated 
and computed communalities were small (me- 
dian = .02), the factorizations were not reit- 
erated. The decision as to the number of fac- 
tors to be accepted for rotation was based on 
the statistical criteria of Saunders (Cattell 
1952, pp. 300-301), McNemar (1942a) ai 
Burt (Cureton, 1955), and on the result 
of the previous factorization of the WAIS 
(Cohen, 1957b). The statistical criteria 
inconsistent with regard to the accepta: were 
the fifth centroid, but since the WATS h of 
yielded five factors in three adult age ad 
and since the extraction of rea Pe > 
“error”) factors results in their vanities 


2To save printing costs, ss 
loadings and communalities, ele ate centroid 
and intercorrelations among primaries h ion matrices 
posited with the American Doaiimentcaee been de- 
Order Document No. 5923, remitting $1 atte Institute. 
film or $1.25 for photocopies. 91.23 tor micro- 
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the process of rotation, five centroids were ex- 
tracted in each group. The “reality” of the 
fifth factor is attested to by its consistency 
among the three children’s groups and with 
the adult groups on the WAIS (Cohen, 
1957b). 

2. Rotation was essentially blind and inde- 
pendent in the three groups, and was per- 
formed by Thurstone’s method of two-dimen- 
sional sections (Thurstone, 1947, pp. 194- 
216). The rotation criteria were oblique sim- 
ple structure and a positive manifold with 
maximization of the number of variables in a 
=.05 and =.10 hyperplane (Cattell, 1952, pp. 
235-236). 

3. The intercorrelations among the oblique 
primary factors were determined and sub- 
jected to a second-order general factor analy- 
sis (Thurstone, pp. 273-277, 421-434), as a 
product of which the correlations of the sub- 
tests with this general factor were obtained. 
This analysis made possible the determination 
of the proportion of total and of true (non- 
error) variance attributable to the second- 
order general factor and comparisons with 
these proportions found for adults on the 
WAIS (Cohen, 1957b). 


Results and Discussion 


Five oblique primary factors were found in 
each age group. Factor loadings in excess of 
.20 are accepted as significant for the pur- 
pose of factor interpretation.’ To facilitate 
comparisons between age groups in Table 1, 
loadings between .20 and .39 are followed by 
an asterisk (*), and loadings of .40 and higher 
by a double asterisk (**). The factors were 
found to be very similar in the three age 
groups, a finding to which we have grown 
accustomed (Cohen: 1952b, 1957b). Table 1 


3 The use of the .20 significance criterion in place 
of the more conventional (and arbitrary) .30 is justi- 
fied as follows: This investigation can be viewed as 
a set of three replications of a factor analysis (with 
the WAIS study [Cohen, 1957b] providing four 
more); therefore, consistency between groups is an 
effective guard against the acceptance of nonsignifi- 
cant loadings as significant, and superior to the rule- 
of-thumb .30 criterion, which would lead to spuri- 
ously inconsistent results between groups. Further 
justification of this criterion is provided by the fact 
that of the 180 factor loadings, only six were be- 
tween .10, the upper limit of the hyperplane, and .20. 


Jacob Cohen 


is accordingly organized by factor. Decimal 
points are omitted in the factor tables through- 
out. 


Factor A: Verbal Comprehension I 


The subtests do not load this factor in the 
three groups of children with quite the neat 
consistency which obtained for the four adult 
groups on the WAIS (Cohen, 1957b, p- 284). 
All three children’s groups load Information 
and Similarities, Arithmetic fails to load ™ 
the oldest (13-6 years old) group, Compre 
hension loads only in that group, while yo 
cabulary loads in the youngest and oldes 
groups—in the latter heavily (see Table rak 
These tests are all verbal, and the factor a 
named Verbal Comprehension I, the roria 
numeral being used to distinguish it = 
Factor D, which also involves verbal subtes a 

Since there are only five verbal subtests 
all, no confident interpretation of paro a 
which distinguishes it from Factor D nie 
Verbal Comprehension II) can be made. ob 
ever, an hypothesis consistent with the b 
served loadings on the two factors Can i 
offered. Factor A seems to reflect that asp 
of verbally retained knowledge impresse 
formal education: facts (Information three 
verbal categorizing (Similarities) at all etic 
ages, and number manipulation (Arithm A 
at ages 7-6 and 10-6. The pivotal age 
Information, which does not appear On othe! 
tor D (or any other). Factor D, on the jise 
hand, seems to stress judgment and is the 
cussed below. The differentiation between he 
two factors should not be overstressed 4 
light of the correlations between them s ‘ih 
.82, and .43 in ascending order of age cate? 
three groups. (Indeed, when factor EEn 
come to be discussed below, it will be A 
that these two factors are combined 1” 
single verbal factor.) 

By age 13-6, the composition 0 ae 
is “stabilized” in that it is loaded by the - 
four subtests as appear on it throug ` n, 
the adult years on the WAIS: Informati y 
Comprehension, Similarities, and Vocab iie 
(Cohen, 1957b). Factor A, then, is iden a 
as the well-established verbal comprehens d 
factor found in all previous factor-analy 
studies of the W-B and WAIS with norma 
at different age levels (cf. Balinsky, 194?’ 


n 


j 


f Factor A 


jc 
Is 
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Table 1 
Oblique Primary Factors for the Three Age Groups 


B 
Percept. Org’n. 


Verbal Comp. II (Quasi-Specific) 


Free. Distract. 


Verbal Comp. I 


10-6 


10-6 


Age 


Subtest 


Factorial Structure of WISC 


287 


Birren, 1952; Cohen, 1957b; Wechsler, 1958) 
as well as with psychiatric patients (cf. Cohen, 
1952a; Cohen, 1952b; Hover, 1950; Simkin, 
1950), which in turn is the same factor found 
in all general investigations of the intellec- 
tual domain (cf. Thomson, 1951). 


Factor B: Perceptual Organization 


This factor is readily identified with Fac- 
tor B in the adult group. The same two sub- 
tests, Block Design and Object Assembly, 
load it consistently and exclusively in the 
three children’s age groups (see Table 1-B) 
as they did in the four adult age groups 
(Cohen, 1957b). The affinity to this factor of 
Picture Arrangement seen here at age 7-6 
is also found in some adult groups (Cohen, 
1957b, p. 285). Picture Completion loads 
here at ages 10-6 and 13-6, and Mazes, 
which has no match on either the WAIS or 
W-B, appears at ages 7-6 and 10-6. 

This factor has appeared consistently in 
previous factor-analytic studies of Wechsler 
scales, and although it has been variously 
named, there is no mistaking its identity (see 
references in Cohen, 1957b, and Wechsler, 
1958). The tests which load it are all non- 
verbal and require the interpretation and/or 
organization of visually perceived materials 
against a time limit. It is thus given the same 
name as in the WAIS study, Perceptual Or- 
ganization (Cohen, 1957b). 


Factor C: Freedom from Distractibility 


In Table 1-C, the consistently and exclu- 
sively loading subtest is Digit Span, while 
Mazes loads at 10-6 and 13-6, and Picture 
Arrangement, Object Assembly, and Arith- 
metic each load in a different group. At 13-6, 
the two significantly loading subtests, Arith- 
metic and Digit Span, are the same ones as 
appear throughout the adult range (Cohen, 
1957b). 

This factor has appeared repeatedly in 
previous factorial studies of the Wechsler sub- 
tests, and has been variously interpreted as 
memory (Balinsky, 1941;  Birren, 1952; 
Cohen: 1957a, 1957b), freedom from dis- 
tractibility (Cohen: 1952a, 1952b), attention- 
concentration (Hover, 1950), and concentra- 
tion-speed (Simkin, 1950). In the WAIS 
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Cohen, 1957b), it was pointed out 
fai thee concepts are not as diverse as they 
may seem at first glance, since rote memory 
requires as a precondition the ability to re- 
main undistracted (to attend or concentrate), 
and C was interpreted to be a memory factor. 
In the present study, it is felt necessary to 
revert to the original interpretation of this 
factor as one of freedom from distractibility 
(Cohen: 1952a, 1952b) primarily due to the 
loadings of subtests which clearly do not in- 
volve memory (Mazes, Picture Arrangement, 
Object Assembly), but which it seems reason- 
able to suppose are quite vulnerable to the 
effects of distractibility. To make the point 
explicit, Factor C in Wechsler scales (WISC, 
WAIS, or W-B) is primarily a Freedom from 
Distractibility factor; its interpretation as a 
memory factor in the WAIS study (Cohen, 
1957b) and others (Balinsky, 1941: Birren, 
1952) is in error. 


Factor D: Verbal Comprehension II 


Comprehension and Picture Completion load 
at all three age levels, Vocabulary at 7-6 and 
10-6, and Similarities at 13-6 (see Table 
1-D). This factor seems to change in 
tematic way with increase in age: Voca 
drops out by age 13-6, Comprehension 
from the highest loading in the table 

—6 to a barely acceptable one at age 
and Similarities appears weakly at age 
only Picture Completion loads at the 


(weak) level throughout. The identific. 
of this factor with F 


a sys- 
bulary 
drops 
at age 
13-6, 
13-6; 
same 
ation 
actor D in the adult 
study is readily made by the apparent con- 
tinuation of these subtest trends for the 18-19 
age group on the WAIS (Cohen, 1957b, p. 
286): Picture Completion continues to load 
(and at the same level), the diminishing Com- 
prehension subtest drops to a zero loading, 
and Similarities continues its weak loading. 
When Factor D in all four adult groups 
was considered (Cohen, 1957b), it was seen 
to be almost solely a matter of Picture Com- 
pletion: only this subtest loaded in all four 
groups, and the other three subtests which 
ever load the factor do so in three different 
groups and with barely acceptable loadings 
(.20 to .22). The factor was therefore ac- 
cepted as a quasi-specific in the WAIS study 
and not interpreted. When the results of the 
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present investigation are added for considera- 
tion, a tentative hypothesis about this factor 
suggests itself, namely, that it reflects the ap- 
plication of judgment to situations following 
some implicit verbal manipulation. The sug- 
gested differentiation from Factor A is that 
the latter represents formally learned verbal 
comprehension, while Factor D is the applica- 
tion of verbal skills to new situations. This 
differentiation is consonant with the finding 
e.g., Comprehension declines as a measure 0 
judgment as formally learned “right” answers 
are acquired. 

Since the distinction between these two fac- 
tors is not sharp, either in conception or in 
the light of the already noted substantial cog 
relations between them, and since such dis 
tinction which has been made is based A 
ad hoc reasoning, Factor D is called Verba 
Comprehension II, and neither factor is mo 
specifically identified. This more consents 
position simply holds that two highly a 
related factors were found loaded primarily 
by overlapping verbal subtests. 


Factor E 


As was the case in the adult study (con 
1957b, pp. 286-287), the only seit at 
loading subtest is Coding, which is equiva A is 
to Digit Symbol (see Table 1-E). ees a 
rangement loads this factor more subs ae 
tially than does Coding in the older a 
groups, but fails to load it at all at age Ai 
In the adults one also finds some ama oa 
Factor E in Picture Arrangement (ages sind 
54), but again the only consistently loading 
subtest is Digit Symbol. 

No pani te interpretation of Factor E 
is offered here, nor was any offered in aa 
WAIS study. It is not an important factor E 
terms of the amount of variance it aco 
for in any of the children or adult gronna 
But it is “real” in the sense that its ginie" 
appearance in both studies precludes its i 
tribution to sampling fluctuations in the su 
test intercorrelations. 


Second-Order General Factor 


As already noted, the rotations were oblique: 
and the result was a substantial degree of cor- 
relation among the primary factors in all three 
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Table 2 


Correlations With G of WISC Subtests and Primary 
Factors for the Three Age Groups 


=e_e_NT _ EOE 
Age 
Subtest 7-6 10-6 13-6 
Information = a 9 78 
Comprehension so ma ees 
Arithmetic ól 74 64 
imilarities 58 67 72 
ecabulary 6 86086. «sD. 
{git Span 58 52 46 
Icture Completion 47 42 H 
icture Arrangement 60 67 53 
ee Design 48 58 58 
ject Assembly 47 43 48 
Oding 38 49 55 
Mazes 37 49 49 
Primary Factor 
A 83 85 91 
B 53 29 64 
& 87 82 90 
D 8 93 33 
8 
E 9 91 87 
ó! 


eeups.t When these matrices of factor inter- 
one ations are factored in turn, they are 
leah to be substantially (but not cour 
ord Y) accounted for by a single me 
GNE general factor. Table 2 gives the a 
ont? of the subtests and the primary fan 
S with this factor, G, which is interprete! 
Present general intellectual ability. The G 
relations of the subtests are moderate 
a dian over all age groups = -58) ee 
dia, Primary factors quite high Mo gr a 
of n .84). The degree of correlation wi a 
r the subtests is not quite so high for Ser 
adul on the WISC as it was found to be a 
on on the WAIS (for further shen. 
this point, see below); still, the magnitnes 
Pu Substantial and suggest that the V ; 
l Scale IQ, which is a linear function 2 
€qually weighted sum of subtest ween 
es is loaded quite strongly with and, 
Nee, is a good measure of G- This is, M 


Cor 


4 
aya median and range of primary fw 
Age ‘ations for the three gro 
71, 2-6 Mdn= 56, R= .39-.78; age 10° 
1 X= 18-83; age 13-6, Mdn =.56, R= 
Ap Primary factor intercorrelations are given 
Material (see Footnote 2). 


in the 
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fact, the case. When the correlation of Full 
Scale IQ with G is determined, using the cor- 
relation of sums formula, it is found to be .92, 
.94, and .95 for the three groups in order of 
increasing age. The “Verbal IQ” is an equally 
good measure of G (.93, .94, and .94), while 
the “Performance IQ” is a relatively poor one 
(.78, .82, and .81). 

As has been found in the past work with 
the W-B (Cohen: 1952a, 1952b; Wechsler, 
1958) and the WAIS (Cohen: 1957a, 1957b; 
Wechsler, 1958), the “essentially verbal” 
tests, particularly Vocabulary and Informa- 
tion, are consistently the best measures of G 
over the age range considered; the poorest 
are Picture Completion, Mazes, and Object 
Assembly. Among the primary factors, except 
for the anomalously low correlation with D at 
ages 13-6, it is Factor B which is consistently 
the poorest measure of G, while the others 
are, on the average, about equally and highly 
related. These results parallel the G correla- 
tions of Verbal and Performance IQs noted 
above. 

In the WAIS study, noteworthy shifts in 
the correlations of subtests and major factors 
with G occurred as a function of age in the 
60-75+ age group (Cohen: 1957a, 1957b). 
Over the age range from 7-6 to 13-6 of the 
present study, no such shifts occur; the sub- 
tests and factors maintain fairly consistent 
levels of correlation in the three children’s 
age groups as they did for the three younger 
adult age groups, i.e., 18-19, 25-34, and 


45-54. 


Subtest Specificity 

A body of doctrine has come down in the 
clinical use of Wechsler scales, which involves 
a rationale in which specific intellective and 
psychodynamic trait-measurement functions 
are assigned to each of the subtests (e.g., 
Rapaport, 1945). This has been used to pro- 
vide a theoretical basis for both research in 
pattern analysis and in clinical psychodiag- 
nosis. Implicit in this rationale lies the as- 
sumption that a substantial part of a sub- 
test’s variance is associated with these specific 
measurement functions. In previous work 
with the W-B for neuropsychiatric patients 
(Cohen: 1952a, 1952b) and with the WAIS 
for the standardization data (Cohen: 1957a, 
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1957b), the basis for this doctrine was chal- 
lenged on grounds of small specific variance 
for the subtests. When the communality of a 
subtest (proportion of variance shared with 
other subtests) is subtracted from its internal 
consistency reliability coefficient (proportion 
of true, i.e., nonerror variance), the remainder 
constitutes the subtest’s specificity, the pro- 
portion of its variance which is both nonerror 
and distinctive to it. This component of the 
subtest’s variance, and only this component, 
can carry the variance necessitated by an hy- 
pothesized one-to-one correspondence of sub- 
test to trait in any clinical rationale. 

These values for the age groups on the 
WISC are presented in the Subtest-Specificity 
section of Table 4. The over-all median of 
these values is .18, and excepting only Mazes 
(the only subtest not represented in the adult 
scales), no subtest at any age has as much as 
one-third of its variance attributable to speci- 
ficity. It is apparent that these specificities are 
quite inadequate to serve as a basis for a sub- 
test-specific rationale. 

Thus, it is true for the WISC (as it is for 
the WAIS in normal adults and the W-B in 
patients) that a subtest’s measurement 
tion is most meaningfully and completely de- 
scribed in terms of G and the primary abili- 
ties, which account for the bulk of its reliable 
variance, and not in terms of its small (essen- 
tially uninterpretable and probably complex) 
Specificity. Adherents of the “clinical” ra- 
tionales can find no support in the factor- 
analytic studies of Wechsler scales, A detailed 
rationale for the subtests, based on the present 
factor analyses, is presented in a later section. 


Age, G, and Intellectual Organization 


The availability of complete analyses of the 
same set of intelligence subtests for repre- 
sentative subjects over a wide age range makes 
possible for the first time direct scrutiny of 
changes in intellectual organization concomi- 
tant with age. In the following discussion, let 
it be understood that generalizations about 
intellectual organization carry along the quali- 
fication “insofar as Wechsler subtests are 
broadly representative of the complex 
functions considered relevant to 
Despite this qualification 
thor unlikely that anoth 


func- 


of 
intelligence.” 
» it seems to the au- 
er collection of sub- 
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tests drawn from within the same framework 
would lead to substantially different conclu- 
sions. 

It has already been noted that the same 
correlated primary factors appear at each of 
the age levels 7-6, 10-6, and 13-6 of the 
WISC standardization samples, that these are 
substantially correlated, and thereby give rise 
to G. The analysis which was performed 
makes possible the determination of the 
amount and proportion of variance attribut- 
able to each of various identifiable sources: 


1. G—the general second-order factor, i.c present 
general intellectual functioning; that part of the varh 
ance shared by all the subtests, the 

2. c—the communality (h*), ie. that part of ts 
variance common to two or more of the anres A 
This includes all influences leading to intercorrela 
tions among subtests (including G), sac to 

3. s—that part of the variance which is specific s- 
a given subtest in a battery and consistently at 
ured by it (see Preceding section, Subtest Specificity? j 

4. e—random error of measurement variance, i€» 
the subtest’s “unreliability,” 


Table 3 represents the average proportions 
of the subtests attributable to the anovi 
Sources at each age for the three pence 
groups on the WISC, as well as compara 


Table 3 sa 
` 'ariou 
Proportions of Total Variance Attributable to yan 
Sources for the Three Children’s Age Group 
on the WISC and the Three Adult 
Age Groups on the WAIS* 


—— 
Source ak 
oe ———— 
Age Group G c s 
Children 
7} 30 48 19 = 
10} 40 57 18 56 
133 36 54 19 
8 
Mean 35 53 18 2 
Adults A 
18-19 53 67 14 : $ 
25-34 50 64 16 i 
45-54 54 67 15 
9 
Mean 52 66 15 19 
1 hart 
t sum to unity because of overlap—G je re 
er ere Eales sour eran Unity in each row 


(within rounding errors). 
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data on three adult groups on the WAIS 
(Cohen, 1957b). G accounts for .30-.40 of 
the total variance in the children’s groups, the 
mean over the three groups being .35, and no 
Monotonic age trend is noted. , 
_ Inferences about the extent of generality of 
Intellectual functioning cannot be restricted 
Solely to a consideration of G, since some 
Subjectivity occurs in the course of rotating 
ee oblique simple structure. When, alterna- 
tively, one scrutinizes the communality (c, 
Table 3), which is determined objectively and 
fairly directly from the subtest intercorrela- 
tions, a Picture similar to that of G emerges 
for the three children’s age groups. Com- 
muna] variance on the average accounts for 
about half of the total (.53), with aod 
arge differences nor a monotonic trend wit 
age in the children’s groups. 
“ith respect to a and error, the 


5 is 
Ormer remains constant, while = SR ite 
igh i spate s compare 
Sh in the 74-year-olds a Soe the fact 


two older groups. This simply re btests 

at the reliability coefficients of the anehi 
are lower at this age, so that pecs vari- 
ĉtror accounts for about one-third of fe older 
ance in contrast with one-fourth for the 


Children. nips of chil- 
Par aro! 
Summarizing for the aree ee variance 


dren, ab ta A 
» about half of the to 5 f this 

i A -thirds of U 

'S shared in common and two-t function 


É is a 
“oOmmunality (.35 of the et ee reflects 
higher 


™mediately the differences ae 

ult age groups—they are eee io a consid- 
safely be ignored. Turning, them i at G ac- 
“ration of the mean values, We ] variance, an 
Counts for fully .52 of the ie that for the 
amount half again as ogee two-thirds 
children. For the adults; h characterize adult 


hic! 
. 7 Note that the statements ee fale ages up to a 
aitellectual functioning refer tO enerality compar 
54. Th Cntjally greater Zene 60-75+ age 
id e substantially wr holds for ts for only 
With children no longer n 


: |. G accou iy 
‘Toup. In this geriatric ed an amount only 
sd varis 
42 of the total WAIS 


f ldren (Cohen, 
; o: 

Slightly greater than that 

1957h, p, 289). 


nce, an 
the chi 
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(.66) of the total subtest variance is shared 
among the subtests in contrast to the .53 fig- 
ure for the children. G variance accounts for 
four-fifths (.52/.66 = .79) of the communal- 
ity for the adults and for only two-thirds 
(.35/.53 = .66) of the communality for the 
children. The amount of specificity is slightly 
smaller for adults, and a amount of error 
jari; antially smaller. 

be eae adults show both higher 
generality and communality of intellectual 
functioning than children suggests itself with 
some force. This conclusion is persuasive even 
in the absence of sampling error formulae in 
the light of the gap of 10 between the highest 
G proportion in the children’s groups (.40 i 
age 10-6) and the lowest G proportion in the 
adult groups (.50 at age 25-34). T 

This conclusion is in flat disagreement with 
what is generally held to be the case in the 
literature. The doctrine of intellectual differ- 
entiation with age is most explicitly stated by 

ett (1946): “Abstract or symbol intelli- 
a changes in its organization as age in- 
creases from a fairly unified and general abil- 
ity toa loosely organized group of abilities or 

rs” (p. 373). Operationally, this would 
erie by a decrease between childhood 
and adulthood of general factor variance, 
ommunality variance, mean intercorrelation, 
a first centroid factor variance. 

Garrett (1946), Anastasi (1948), and Burt 
(1954) review the evidence for this differen- 
tiation hypothesis. It is based on some studies 
which show a reduction in G with age during 
childhood (although the most extensive of 
such studies, that of McNemar on the Binet 
[McNemar, 1942b], does not), and on dem- 
onstrations of more G in elementary school 
children than in college students. The latter 
is readily explained as due to the selection 
for intelligence at the college level (which, 
because of the narrowing of the “range of 


ë These conclusions are not changed when the 
“true” (ie, nonerror) variance is analyzed to allow 
for the lower subtest reliabilities of the children: on 
the average, (a) .49 of the true variance of children’s 
scores is associated with G compared to .64 for 
adults; (b) the communality constitutes .74 of the 
true variance for children and .82 for adults; (c) 
complementarily, there is substantially more speci- 
ficity in intellectual functioning in children (.26) 
than in adults (.18), 
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Table 4 


Proportions of Total Variance Attributable to Various 
mE and IQs at Ages 7- 


Sources for the WISC Subtests 
6, 10-6, and 13-6 


Source 
Primary- Subtest- 
General Specificity Specificity Error = 
a p 13-6 
Subtest Age: 7-6 10-6 13-6 7-6 10-6 13-6 7-6 10-6 13-6 7-6 10-6 

18 
Inf. SA 62. g 23 13 15 06 05 06 34 a 29 
Comp. a Se A0 6 B 318 08 05 13 41 6 
Arith. Se Do, Ad 2 m y 14 18 25 37 o al 
Simil. 34 45 52 10 18 15 2 6 %2 34 a 0 
Voc. 48 74 62 11 0 11 18 10 17 23 a 
D. Sp 34. 2 gy aL ag 1S Jd 49 40 a 
P.C. 223 18- 17 11 24 34 26 2 $7 41 SE (28 
P.A 36 4 328 16 10 15 20 16 29 28 > n 
B. D 23 34 34 28 34 26 33 19 28 16 a 2 
0. A 22 18 23 37 37 48 04 13 00 37 “o 40° 
Coding 14 24 30 17 04 o4 29 32 26 40 iol e 
Mazes 14 24 24 31 19 04 34 38 47 21 i 26 

Mean 30 40 36 w.ar i8 19 18 19 33 

Battery- 

Specificity F 
Verbal IQ 86 89 89 03 o5 o4 11 08 10 
Perf. IQ 61 68 65 27 22 25 12 os 0 

F. S. IQ 85 88 © 191 08 07 o% 07 


Note.—Decimal points omitted. 
* Estimated, (See Wechsler, 1949, pp. 13-14.) 


talent,” results in low te 


rather than to age as such. When unselected 
children are compared with unselected adults 
in generality of intellectual functioning on 
representative tests, the differentiation hy- 


pothesis is rejected; in fact, we find greater 
generality of intelle: 


ctual functioning in adults 
than in children, 


st intercorrelations) 


A Rationale for the Subtests 


In previous articles, rationales for Wechsler 
subtests were presented based on factor analy- 
ses of the W-B in neuropsychiatric patients 
(Cohen, 1952a) and of the WAIS standardi- 
zation population (Cohen, 1957a). In order 
to adduce a similar rationale for these subtests 
on the WISC, for each subtest in each age 
group the proportion of variance attributable 


to the following sources was determined (see 
Table 4): 


1. General: Variance due to G is on the whole 
larger than the other sources; this simply underscores 
the importance of the general factor in the WISC. It 


ble 

is of importance that the reader note that eee 
entries are proportions of variance, not corre! able 
the latter are higher—the square root of the 
value—and have been given in Table 2. t is 

2. Primary-Specific: As used here, this concer i 
meant to identify the proportion of a subtest Sad 
ance which is shared with at least one other su heni 
over and beyond G. In previous analyses Cot 
1952a, 1957a), this has been identified as eae 
specific variance, i.e., that part of each primary ant 
tor’s variance specific to the factor and indepen Ae 
of G. The tabled entries here combine the van ine 
of all primary-specifics, although for most a ihe 
subtests one factor predominates. The nature 0 Ab 
primary-specific variance of each subtest was de 
mined in the basic analysis (Table 1). te 

3. Subtest-Specific: This represents what each A 
test measures exclusively (and validly) in the sce 

4. Error: This is the proportion of variance ie 
counted for by random error of measurement, ee 
unreliability. These values are, on the average, ee 
fifths as large as the G proportions, and suggest ve 
wisdom of caution in the interpretation of single su 
test scores, 


The rationale which follows is for the most 
part an interpretation of Table 4, to which 


y 
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the reader should freely refer without explicit 
reference, 


Information 


oe subtest occupies an uncontested second 
on after Vocabulary, as a measure of G 
Elan os WISC subtests, particularly for 
fth c ildren, where G accounts for three- 
doe s of its variance. In the 74-year-olds, it 
i Sa not perform as well in measuring G, but 
high at this age level, because of the relatively 
oo unreliability (an average over the sub- 
any of a third of the variance), most of the 
tests show less G variance than at later 
ages, 
Q Information is the only subtest which loads 
actor A consistently and solely; it was the 
asis of the hypothetized distinction between 
ee A and D. Thus, all its primary-sP& 
-C variance can be attributed to verbal 
pe edge. Unfortunately, this is not much: 
ae age 7-6 and .13—.15 at the other ages; 
Vari of these amounts is less than the error 
on, lance at each age. For a younger subject, 
ii might hazard an interpretation of the In- 
o i oa score as specific verbal knowledge 
"ly when it is quite deviant (at least 3 
ao) from the general subtest average. 
eran for a young subject, given the amount 
RR variance, this is done at considerable 
È ; for older children, where the pene 
ee Proportion is even smaller, the TS 
Ould not be taken. ; 
te S is usually the case for the WISC lg 
ests, no subtest-specific interpretation (e.8-; 
is boy is unusually well informed about 
Zenera] facts for his ability level’) should be 
an given the .05-.06 of the Information 
oS so occupied. j tr 
RUG. will be found to be the case 1m seve n 
tests, the major utility of Information 
aS a measure of G and the Verbal Compre- 
pon Factor (see below; Factor Scores) in 
Ombination with other subtests. 


(8y 
omprehension 


This is a moderately good mea 
Compared with a the Fher subtests, but un- 
distinguished when compared to the other 

essentially verbal’. subtests 

Pee ss and Vocabulary)- 

Bee edly due to the fact it ha 
Or variance in this group. 


sure of G 


(Information, 
This is un- 
s the highest 
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In its primary-specific variance, it is of in- 
terest in that, as age increases, it goes from 
high to low loadings on Factor D and from 
zero loadings at 7-6 and 10-6 to a substan- 
tial loading at 13-6 on Factor A (Table 1). 
This subtest was central in the tentative in- 
terpretation of Factor D as stressing verbal 
judgment. Due to the fact, however, that its 
error variance is twice the size of its primary- 
specific variance, and the further fact that the 
latter contains mixed A and D variance at 
13-6, it is not recommended that in clinical 
practice Comprehension scores be interpreted 
as measuring verbal judgment (or knowl- 
edge). The low subtest specificity also pre- 
cludes any interpretation along those lines. 
The subtest’s major utility lies in its com- 
bination with others as a measure of G and 
of Verbal Comprehension. 


Arithmetic 
Arithmetic is quite similar to Comprehen- 
n as a measure of G, better than any of the 


sio: 
performance tests, but not as good as Vo- 
cabulary or Information. Apart from G, its 


primary-specific variance is small (.11—.12) 
and varies with age: at 7-6 and 10-6 it is 
Factor A variance, while at 13-6 it takes on 
the measurement function which it maintains 
until old age, Factor C, Freedom from Dis- 
tractibility. Under these circumstances, and 
with an average of a fourth of its variance in 
error, interpretation of a subject’s score on 
Arithmetic in terms of either of these factors 
(depending on age) is inadvisable. (Note be- 
low, however, its use in combination with 
Digit Span.) 

For children at 10-6 and 13-6, subtest- 
specific variance on this test compares rela- 
tively favorably with (i.e., is a little greater 
than) error variance. Thus, one can draw in- 
ferences of specific Arithmetic ability or dis- 
ability, but only when there is a substantial 
departure of the subtest score from the mean 
of the other (particularly verbal) subtests 
Using this mean as a reference point has the 
effect of partialling out G, which accounts fo 
the largest amount of the subtest’s ataia 


Similarities 


This subtest is similar to Comprehension in 
that it is a moderately good measure of G 
(surpassed only by Vocabulary and Informa- 
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tion), with .44 of its variance, on the aver- 
age, so occupied. 

At 7-6 and 10-6, its primary-specific vari- 
ance comes from Factor A, while at 13-6 it is 
made up about equally of A and D. Again the 
amount is small, both absolutely and relative 
to the amount of error variance, and clinical 
interpretation along these lines is precluded. 
The same consideration applies to its subtest- 
specific variance. 

The major utility of Similarities, therefore, 
lies in its combination with other subtests in 
the formation of factor scores. 


Vocabulary 


This subtest stands out as it has in the 
other analyses (Cohen: 1952a, 1952b, 1957a, 


On the average, 
e, and this aver- 
gest group, where 
istently low. The 
13-6, respectively 
Correlations with 


Because of the f. 
verbal in character, 
as Vocabulary has 1 
ance, and not much 
ance. The source of 
ance is mixed a 
changes, going 


act that G is so strongly 
a good measure of G such 
ittle Primary-specific vari- 
more subtest-specific vari- 
the primary-specific vari- 
S a function of developmental 
from primarily Factor D vari- 
ance to Primarily Factor A variance (where it 
remains in adulthood). Therefore, despite the 
relatively (and at 10-6 and 13-6 absolutely) 
low error variance, specific interpretations of 
scores are not advised. Vocabulary is essen- 
tially a G measure, used either by itself or in 
combination with other subtests. It can also 
be used, as will be seen below, in the construc- 


tion of a factor score to measure Verbal Com- 
prehension. 


Digit Span 


The most salient characteristic of this sub- 
test is its poor reliability, the lowest, on the 
average, of the subtests. With from 40-.50 of 
its variance made up of measurement error, 
it follows that it cannot be depended upon 
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by itself as a measure of G nor of Freedom 
from Distractibility (although it measures it 
purely). Although it has utility in combina- 
tion with Arithmetic as a measure of Factor 
C on the WAIS in adults (Cohen: 1957a, 
1957b) and in older children (see below), at 
ages 7-6—10-6, the Arithmetic test carries 
Factor A variance and Digit Span cannot be 
so combined. 


Picture Completion 


This test is one of the four outstandingly 
poor measures of G on the scale (the others 
being Object Assembly, Coding, and Mazes). 
It averages only .19 (r = .43) of its varianci 
so occupied. 

The Pansi variance of Roig 
Completion is of interest from a aie? 
mental point of view. During the entire adu ; 
age range, it is the only subtest found to a 
sistently load Factor D, which led to the zom 
sideration of this factor as a Picture Com- 
pletion specific in the WAIS study (cohen 
1957a, 1957b). In the present analysis, a 
though Picture Completion again loads Fa 
tor D consistently, verbal subtests also loge 
this factor, and Picture Completion has men 
portant loadings at 10-6 and 13-6 on sare 
B (Table 1). Thus, the relatively large PT 
mary-specific variance at ages 10-6 and et 
(Table 4) cannot be attributed to any abe 
source. Further, this subtest’s error variance if 
the largest among the subtests, which by itse 
precludes specific interpretations. 


Picture Arrangement 


This subtest has the distinction of providing 
the best single measure of G among the pa” 
formance scale tests, with an average propor 
tion of G variance of .36 (r = .60). It is pal” 
ticularly good in this regard at ages 7-6 ane 
10-6. Although this level of G variance is a 
ceeded by all the verbal scale subtests ae 
Digit Span, in the testing of children with 
language or educational handicaps where ver- 
bal subtests are invalid, this subtest can be 
used, particularly in combination with Block 
Design, to get a nonverbal estimate of G. 

High error variance and mixed sources of 
primary-specific variance preclude interpreta- 


tion of Picture Arrangement scores along spe- 


ae 


y 


`> 
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ci ~ “y: . . . 
an it Its utility lies in its measurement 


Block Design 


Ra is a very useful subtest in its measure- 
This i oth of G and Perceptual Organization. 
ance is made possible by its low error vari- 
on ee hic Vocabulary as re banat 
groups, ale when averaged over the three ase 
Although the proportion of G v 
lok Design does not average quite as h 
a that of Picture Arrangement, the former is 
Uperior at age 13-6. Thus, at older ages in 
Particular, Block Design may be a useful non- 
tba] measure of G, especially in combina- 
lon with Picture Arrangement. 
t This is the first subtest thus far encoun- 
ered which is found to have utility in the 
Measurement of a primary-specific factor. 
Block Design loads only Factor B, and loads 
it quite heavily in all age groups. Thus, the 
Proportions of variance attributed to primary- 
Specific sources given in Table 4 (.28, 34 
26) are identifiable as almost completely due 
to a specific ability in speeded perceptual or- 
Sanization (Factor B) over and above G. — 
Since Factor B has the lowest correlation 
With G, after G is allowed for there remains 4 


Considerable amount of B primary-specific 
is also about 


Variance in Block Design. There 
an equally substantial amount of subtest-spe- 
cific variance which is likely to be largely due 
to spatial visualization ability- 
Thus, Block Design is a good measure of 
for a nonverbal test. and = god meas 
of perceptual organization ability. This latter 
Quality is shared with Object Assembly- 


ariance in 
igh 


Object Assembly 
enly found to be 


This test has been consist 3 
a poor measure of G (Cohen: 52a, ee 
1957a, 1957b) and the present findings for 
children agree. It not only has @ small pro- 
Portion of G variance (.18-.23) h 
igh proportion of error variance 10 the three 
Sroups, .37, .37, and .29. Object Assembly 18 
therefore a very poor choice as a measure 
of G. a P 

Very little of its variance is specific to it, 
hus, the remaining proportion of the var” 
ance (.37, .32, -48) constitutes the largest 
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amount of primary-specific variance among 
the subtests, and since its primary factor load- 
ings are high and fall exclusively on Factor B 
(Table 1), all the primary-specific variance 
can be attributed to perceptual organization 
ability. Its already noted poor reliability ham- 
pers its use as a measure of Factor B by it- 
self, but in combination with Block Design 
(and in younger children, Mazes), a poten- 
tially useful measure of Factor B results (see 


below). 


Coding 

Except for a minor change of content in 
Coding A in younger children (Wechsler, 
1949, pp. 85-86), this is equivalent to the 
Digit Symbol test on the WAIS and gives re- 
sults identical with it—it loads exclusively 
and consistently on Factor E, and since it is 
the only subtest which does so, Factor E re- 
mains uninterpreted. 

Error variance is estimated (Wechsler, 
1949, pp. 13-14) as being so high as to rank 
this test among the two or three poorest in 
this regard. Taken together with its relatively 
low G and primary-specific variance, the re- 
sult is a subtest the bulk of whose reliable 
variance lies in its specificity (whose nature 
is of necessity unknown) which is in turn 
smaller than its estimated error variance. 
Taken by themselves, then, Coding scores are 


of limited utility. 


Mazes 

This is the only subtest on the WISC which 
has no counterpart on the W-B or WAIS. Al- 
though the proportion of its variance attribut- 
able to G in the three groups is relatively low 
(.14, .24, .24), it is nevertheless a useful sub- 
test. To begin with, it is not crippled by high 
error variance as are most of the other per- 
formance subtests. This gives it “room” in 
which to measure usefully. Its primary-spe- 
cific variance at the younger ages is substan- 
tial (.31 and .19) and is primarily occupied 
in the measurement of Perceptual Organiza- 
tion. In these younger years, its combination 
with Block Design and Object Assembl 
makes for a useful measure of Factor B At 
age 13-6, however, only .04 of its variance is 
primary-specific, and this insignificant amount 
is not from Factor B, but from Factor C 
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More by far than any other subtest (with 
from a third to almost a half of its variance), 
Mazes measures something quite specific to it. 
What this is cannot be determined from the 
present study by the very nature of subtest 
specificity. However, Porteus (1950), who has 
long been associated with this item-type, be- 
lieves the subtest to measure “planning abil- 
ity.” A consideration of this subtest suggests 
that it is reasonable to identify most of Mazes’ 
specificity with this function. This would then 
mean that if a child’s Mazes score departed 
by several points from his other subtests 
(from Block Design and Object Assembly in 
particular), it is reasonable to interpret it as 
a consequence of planning ability, as such. 


WISC IQs 


Utilizing an extension of the formula for the 
correlation of sums given by Tryon (1958, p. 
27), the correlations with G of the Verbal IQ 
(6 subtests), the Performance IQ (6 sub- 
tests), and the Full Scale IQ (12 subtests) 
were determined and squared, giving the pro- 
portion of variance attributable to G. The re- 
liabilities of these composite IQs were found 
as a function of the subtest reliabilities by 
means of Tryon’s formula for battery reli- 
ability (Tryon, 1957, Eqs. 10 and 29), and 
from these the proportion of error variance. 
These values are presented for the three age 
groups in Table 4, and, in addition, the 
residual proportions are given under the head- 
ing “Battery-Specificity,” since they represent 
the proportion of valid non-G variance in each 
composite. 

Both the Verbal and Full Scale IQs are ex- 
cellent measures of G. About -85-.90 of their 
variance is so occupied, which, expressed as 
validity coefficients, amounts to a range of 
values of .92—.95. Either of these IQs repre- 
sents well the G defined by the 12 subtests. 
Performance IQs, on the other hand, contain 
only .61—.68 of G variance, which, although 
translated into rather impressive validity co- 
efficients of .78—.82, are relatively poor com- 
pared to the other two IQs. 

The fact that the intellectual functioning 
represented by G is considerably dependent 
on verbality is indicated by the fact that the 
Full Scale and Verbal IQs are about equally 
valid as measures of G. Apparently, when the 


Cohen 


performance scale subtests are added to the 
verbal scale subtests to make up the Full 
Scale IQ, whatever G variance the former 
bring is counterbalanced perfectly by the non- 
G (specificity and error), resulting in no ad- 
ditional validity for G measurement beyond 
that supplied by the verbal scale. b 

Beyond G, the very little variance which is 
left in the Full Scale and Verbal IQs is about 
equally accounted for by error and primary- 
or subtest-specificity, the latter being obvi- 
ously quite negligible for test interpretation 
purposes. 

In the case of the Performance IQ, although 
the error variance is slightly larger, there re- 
mains about a quarter of the total variance 
specific to these tests, which is predominantly 
reflective of primary-specific Factor B, that 
part of Perceptual Organization which does 
not enter into G. In clinical use, the compari- 
son of Verbal with Performance IQ for a sub- 
test is seen to be justified, in that the differ- 
ence between the two reflects the battery 
specificity of the Performance Scale, the ei- 
fect of G having been in effect “partialled out’ 
by subtraction. The modification of clinical 
practice suggested by the present results lies 
in the conception of the Verbal IQ as a meas- 
ure of G, rather than of a “group” or primary 
factor of verbal ability. Another way in which 
this can be put is that insofar as the WISC 
is concerned, no distinction in measurement 
function can be made between the Verbal IQ 
and the Full Scale IQ for the general popula- 
tion of children. 


Factor Scores 


In the article presenting a factor-analytic 
rationale for the WAIS (Cohen, 1957a), fac- 
tor scores for the measurement of the primary 
factors were advocated. The task of formulat- 
ing such scores for the WAIS was simpler 
than proved to be the case for the WISC be- 
cause of the greater consistency of subtests in 
their factor measurement which obtained for 
adults (Cohen, 1957b) than is found to be 
the case in children. 

At the very beginning of this attempt it is 
noted that only Information loads Factor A 
exclusively and consistently, and that while 
Comprehension and Picture Completion both 
load Factor D consistently, neither does so 
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exclusively (Table 1). Since to obtain rela- 
tively unambiguous factor scores at least two 
exclusively and substantially loading subtests 
are desirable, it is not possible to formulate 
Separate A and D factor scores. 

However, it has been pointed out above that 
a distinction between Factors A and D, both 
Rat Verbal Comprehension factors, is not 
aa In the light of the high correlation gen- 
Fes A obtaining between them, and since the 
it ult was perfect consistency with the WAIS, 

Was decided to pool these two factors into 
i Single Verbal Comprehension factor. When 
ane 1s done, it is found that the four ee 
ee loaded either factor both consistently 

‘ exclusively were the same as were com- 
pe ited into a Verbal Comprehension factor 
“ore on the WAIS, i.e., Information, Compre- 
cca Similarities, and Vocabulary (Cohen, 
ie P. 456). Bs 
actor score for Verbal Comprenen 

(We) is found by averaging the WISC 
veighted scores for the above four subtests- 
Pera given child, Verbal Comprehension abil- 
Y is high or low relative to children his ag° 
4S the VC score is above or below 10, the 
Population mean, and high or low ipsatively 
eg within the pattern of the child’s abili 
tes), as it departs from the child’s other fac 
OF Scores, The other factor scores are simi 

arly interpreted. 
ores (PO) 


erceptual Organization factor SC 


ust be differently made up at pent 
3 3 «te the avera 
Bes 7-6 to 10-6, it 15 Sr Sdi Mazes; 


sock Desi ject Assembly, 
Ss an wove, Madad must be or 
a the composite because it ceases to 

ae (Table 1), and the resiltng 
nae is identically composed as it is fo 

AIS (Cohen, 1957a, p. 457)- aries 
ar "teedom from Distractibility e 

€ not available at 7—6 to 10-0, 

eS, no subtest can be found t 

igit Span, which alone loads Factor ea 
Clusively (Table 1). At age 13-6, Arithmet 
can be averaged with Digit Span for an TD 
score, resulting in the same Factor C scor 
Pees for the WAIS (Cohen, 1957a, P- 


the 


f ed 

Finally, since all subtests are cone ib 
cath G, a G factor score is obtained as S ‘vill 
he average of all the subtests. This score W" 
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like the primary factor scores above, have a 
population mean value of 10, and be com- 
parable with them for purposes of ipsative 
measurement. If only a measure of G is re- 
quired, the Full Scale IQ (or the Verbal IQ) 
serves this purpose. If it is not necessary to 
determine the conventional IQs, a short form 
of the WISC can be administered which yields 
all the recommended factor scores. The sub- 
tests necessary for this purpose are: 

Ages 7-6 and 10-6: Information, Comprehension, 
Similarities, Vocabulary (VC); Block Design, Object 
Assembly, Mazes (PO); the preceding 7 subtests’ 
mean gives the short-form G score. ae! 

Age 13-6: Information, Comprehension, Similari- 
ties, Vocabulary (VC); Block Design, Object As- 
sembly (PO); Digit Span, Arithmetic (FD); the 
preceding 8 subtests’ mean gives the short-form G 
score. Note that at this age, the factor scores are 
identically composed as those for adults on the WAIS 
(Cohen, 1957a). 

The significance of these factor scores can 
only be determined by research. However, the 
logical implications of the analysis are such as 
to suggest that these scores, since they follow 
definable functional unities in children, should 
be of greater use than either the relatively un- 
reliable and ambiguous single subtest scores 
on the one hand, or the more or less a priori 
Verbal and Performance IQs on the other 
(Cohen, 1957a, p. 456). 

In order to facilitate the use of these factor 
scores, it is desirable that in addition to the 
population mean (which is 10 throughout), 
the variability of each factor score in the 
population be known. Applying to the stand- 
ardization data the formula for the standard 
deviation of a mean (Guilford, 1950, p. 456), 
the values of the standard deviations of each 
of the above factor scores at each age group 
were determined and are presented in Table 5. 
As an approximation in clinical work, the 
standard deviations of the primary factor 
scores can be taken as 24, and of G factor 
scores (based on 12 subtests) as 2 (in con- 
trast to subtest scores, where the SD is 3). 
These factor scores are normally distributed, 
so that, for example, a primary factor score 
of 15 can be taken as falling approximately 
two standard deviations above the mean and 
therefore in the top 3% of the population. 

For ipsative (i.e. pattern) analysis, the 
factor scores of a subject can be compared 
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Table 5 


Standard Deviations of WISC Factor Scores at 
Ages 7-6, 10-6, and 13-6 


Age 
Factor Score 7-6 10-6 13-6 
VC 2.3 2.6 2.6 
PO 24 2.4 2.7 
FD — = 2.5 
G (12 subtests) 1.9 2.0 2.0 
G (short form) 1.9 22 2A 


among themselves much as subtest scores are. 
The effect of such comparison is to “ 
out” the all-pervading influence of G, 
ing in differences which can be attrib 
what is specific to the 
volved. 


Partial 
result- 
uted to 
primary factors in- 


Summary and Conclusions 


The WISC standardization d 
groups 7-6, 10-6, and 13-6 w 
lyzed by group, 
traction, oblique 
ple structure an 
second-order ge 


ata for the age 
ere factor-ana- 
using complete centroid ex- 
rotation to a criterion of sim- 
d a positive manifold, and a 
neral factor analysis. The pro- 
portions of the variance attributable to the 
general factor, communality, specificity, and 
error were compared both among the chil- 
dren’s groups and with adults’ WAIS per- 


formance (Cohen, 1957b). The follo 
clusions were drawn: 


1. Five correlated f 
sistently in the three 
Verbal Comprehension 
Organization, Freedom from Distractibility, 
and a quasi-specific factor. These are essen- 
tially the same factors which were found for 
adults on the WAIS. 

2. A second-order general factor, G, ac- 
counted for about one-third of the tot 
ance and about one-half of the true 
of the WISC. This factor has a ver 
loading pattern to its adult counterp: 
measured best by the essentially v 
tests, 

3. Subtest specificity is relativel 


wing con- 


actors were found con- 
children’s age groups: 
I and II, Perceptual 


al vari- 
variance 
y similar 
art, being 
erbal sub- 


y small, 
which renders invalid the clinical rationales 
which are dependent on distinctive measure- 


ment functions of the 12 subtests. This again 
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duplicates the findings on the WAIS (Cohen, 
1957b). 

4. It was found that children exhibit a sub- 
stantially smaller degree of generality of in- 
tellectual functioning than do adults. This is 
directly counter to the widely held belief n 
intelligence in children is highly general an 


differentiates progressively as they grow to 
maturity. 


5. Finally, from an analysis of the sources 
of score variance, each subtest’s measurement 
function was discussed in terms of G, the aa 
mary factors, specificity and easurenan 
error. It was found, with some exceptions, tha 
single subtest scores do not lend themselves e 
individual interpretation. Similar anales 
the IQs revealed the fact that both the Ver! p 
and Full Scale IQs are excellent measures a 
G. Some factor scores were proposed, and th 
manner of their utilization was described. 


Received July 25, 1958. 
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DIRECT MEASUREMENT OF COGNITIVE DEFICIT 
IN BRAIN-INJURED PATIENTS: 


HAROLD L. WILLIAMS, ARDIE LUBIN 


» AND CHARLES F. GIESEKING 


Walter Reed Army Institute of Research 


“To measure the effects of any condition 
on efficiency, whether it be disorder, cere- 
bral injury, or age, should require on logical 
grounds that an individual’s efficiency be 
measured before and after the onset of the 
condition. In practice this nice logical re- 
quirement has not been feasible. Only very 
recently has any considerable Proportion of 
the population been given the standard tests 
of intelligence, and no investigator, 


to our 
knowledge, has been able to obtain predis- 
order or preinjury test results from the pa- 


tients in his sample. For this reason substi- 
tute controls have been devised” (Hunt & 
Cofer, 1944, p. 972). 

Direct measures of premorbid in 
are now available on 
Armed Forces. The 


direct measures to a 
tions: 


a. What is the amount of cognitive deficit 
produced by brain injury? 

b. Does brain injury cause differential defi- 
cit in intellectual skills? 

c. What is the b 


telligence 
all patients in the U, S. 
present study uses these 
nswer the following ques- 


est way of using the pa- 
tient’s premorbid and current level of intelli- 
gence to diagnose brain injury? 

In the past, indirect m 
intelligence have been used to answer these 
questions. In dealing with individual patients, 
clinical psychologists have typically assumed 
that certain intelligence tests, such as vocabu- 
lary, were resistant to brain injury, and have 
used these scores to estimate premorbid in- 


telligence. In dealing with groups, population 
norms have been used. 


easures of premorbid 


1 Future papers will deal with the 
ment of cognitive deficit in functional 
neuroses, 


direct measure- 
l psychoses and 


Measures 


All male enlistees and inductees who am 
under draft quotas must take the poe 
Forces Qualification Test (AFQT). The a 
is a spiral omnibus mental test which yie 
a single score. ken 

Since 1948, all enlisted personnel have ta a 
the Army Classification Battery (ACB) uP ai 
entry into the Army, The ACB yields 10 Ra 
rate scores, which, in various combinatio. z 
predict achievement at different Army shona 
with validities of about .60. Each test wer) 
mean of 100 and a standard deviation of T 

By readministering either of these EE 
during or after hospitalization, direct ae 
ures of cognitive deficit can be ohte m 
(Montague, Williams, Lubin, & Gieseking; 
1957). In the present study the ACB we 
used, rather than the AFQT, so that di 
ential deficit could be studied. ad 

The first five tests of the ACB were rae 
ministered to every S: Reading and on 
lary (RV), Arithmetical Reasoning (A de 
Pattern Analysis (PA), Mechanical ADE ta 
(MA) and Clerical Speed (ACS). These al 
tests require about two-and-a-half hou i 
Often it was necessary to have two separa 
testing periods, particularly with bee 
jured Ss. Alternate forms of the ACB T 
used for the retests. The 10 ACB tests havy 
Previously been described in detail (Mo 
tague et al., 1957).2 


Subjects 


All Ss were enlisted males in the U. 5 
Army. The brain-injured group consisted © 


? This study used the 1948 form of the ACB. Since 
June 1957, a revised battery containing 11 tests has 
been in use. 
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Direct Measurement of Cognitive Deficit 


Table 1 


= Bee ui Diagnoses 


Diagnoses 


= 


Traum: SeT 


ane head injuries 8 
be ‘aumatic encephalopathy 7 

M odural hematoma : 
otor seizures 5 

thers 3 
ere z i 

N bral vascular accident 
oplasm 

““Scellaneous 


a ee 


6 , 
fesationts referred by the Neurology and 
Os Osurgery Services at Walter Reed Army 
a Brain injury was defined as intrinsic 
Bives ge above the tentorium cerebelli. Table 1 
tient a summary of the diagnoses. Most pa- 
age S had diffuse rather than focal brain dam- 
varied o the amount of brain tissue involve 
i : considerably, The age range was from 
Of 71 50, with a mean of 27 and a variance 
cover of the 64 brain-injured patients had a 
app et to a point where they could be teste j 
ti řoximately two months after hospitaliza- 
Coy; any brain-injured patients never re- 
ered sufficiently to be tested, and these, 
Course, could not be included in the study. 


€veral control groups were used: 
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b. Duty controls; 55 enlisted men on duty in a 
field hospital at Fort Meade, Maryland, and 60 en- 
listed men on duty in the Walter Reed Troop Com- 
mand. 


A detailed questionnaire was used to de- 
tect any control with a possible head injury. 
Such Ss were not included in the study. The 
age range of the control Ss was from 18 to 51, 
with a mean of 27 and a variance of 48. 


Results 


Table 2 presents the answer to Question a: 
What is the amount of deficit produced by 
brain injury? The brain-injured Ss decreased 
about 67% of a standard deviation, whereas 
the controls increased slightly, about 15% of 
a standard deviation. There were no signifi- 
cant differences between the hospital and 
duty controls. For each test in the brain-in- 
jured group, Student’s ¢ showed that the de- 
crease was significant at the .01 level. 

The second question is a familiar one: Is 
there evidence of differential deficit? That is, 
are any of the five ACB tests relatively re- 
sistant to brain injury? In partial answer to 
this question, Table 2 shows that, contrary 
to the generalizations made by many previ- 
ous investigators (e.g., Babcock, 1930; Hunt, 
1943; Shipley, 1940; Wechsler, 1944), the 
deficit on Reading and Vocabulary is at least 
as great as for any of the five tests. 

For a more complete answer to the ques- 
tion of differential deficit, we can test the 


psy tient controls; 47 non-brain-injured, and ae null hypothesis that the average decrease in 
ital ae Patients from Walter Reed Arm” the brain-injured group on all five tests is 
b 
Table 2 


rbid and Retest Scores for C 


‘ontrols and Brain-Injured Patients 


Difference between ACB Premo! 


Means Variances 
P : Duty 
Brain Patient 1 Brain Patient 
T Is Controls = Duty 

370.6 235.3 
RV 7 14 2.8 5 162.0 
aM rigs ff 14 362.0 200.5 139.3 
SR i 13 4.0 419.0 328.6 302.0 
aa -22 ae 52 392.4 187.5 144.4 
ya 328 1 16 373.3 213.7 143.8 
D SA B38 18.0 5,141.3 1,869.8 1,386.7 


Note,—p is the sum of the differences for all five ACB scores: 
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equal. Two approximate statistical techniques 
were used to test this hypothesis; both gave 
the same result: a significant, but very small 
tendency for PA and MA to resist the effects 
of brain injury. 

The use of approximate statistical tech- 
niques is forced because there is no simple 
exact test for the differences between three 
or more correlated means.’ Therefore, Box’s 
method and Kendall’s W were used. 

a. Box’s (1954) test for differences be- 
tween correlated means. The usual two-way 
analysis-of-variance was calculated for the 
subject-by-difference score matrix, within the 
brain-injured group. Box’s test calls for a 
correction to the degrees of freedom which 
makes an approximate allowance for the effect 
of intercorrelated scores as well as hetero- 
geneous variances. The F ratio for the be- 
tween-tests main effect was just significant at 
the .05 level, when Box’s Correction was ap- 
plied. 

One difficulty of the Box test is that it as- 
sumes multivariate normality of the five dif- 
ference scores whereas, on inspection, it ap- 
pears that in the brain-injured group, the 
scores are skewed negatively, 


b. Kendall’s W test (1948). Therefore, 
Kendall’s rank-order 


but significant at the .01 level, 

What is the best way of u 
morbid and retest scores to diffe 
injured and controls? For grou 
variate normal distributions 
variance matrices, there ar 
possible ways to do this: 
ference, To — T, = D 
of five retest scores 
five premorbid score: 


sing the pre- 
tentiate brain- 
Ps with multi- 
and equal co- 
e only a few 
(a) the simple dif- 
» Where Ty is the sum 
and T; is the sum of the 
S; (b) the residual change 

3 Since submission of this manuscript, we have 
learned that Rao (1952, pp. 239-243) has an exact 


test appropriate to the case where the distribution is 
multivariate normal. 
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score, Ts; = To-a-bT;, which corrects for the 
improvement shown by controls on retest 
(Montague et al., 1957); or (c) the Fisher 
(1941, p. 279) linear discriminating function, 
the multiple regression of all 10 scores (five 
premorbid tests and five retests) on the di- 
chotomous criterion, brain-injured vs. controls. 
An empirical comparison of these three 
methods showed that the cumbersome multi- 
ple regression formula is not necessary here 
for optimal discrimination. The three meth- 
ods are intimately related to each other in 
the following way: the validity of the lineat 
discriminating function must be equal to oF 
greater than the validity of the residual 
change score, which in turn must equal oF 
exceed the validity of the difference score. 
The validity of the residual change score will 
equal that of the multiple regression if (4) 
controls and brain-injured differ on Tz, but 
not on Ti, (4) the correlation between Ti 
and Ty is substantial, (c) the multiple Te 
gression weights for all five premorbid tests 
are near zero, and (d) the multiple regressio” 
weights for all five retests are positive an 
equal. In other words, if T, is a suppresso" 
variable, then the residual change score W! 
yield optimal discrimination (Lubin, 1957)- F 
For the computation of the Fisher oeh 
discriminator, a special subgroup of 64 ma 
was drawn from the sample of 162 controls $ 
that each brain-injured patient was matche 
with a control within 20 points of his Pi 
morbid score, T,. Table 3 shows that matc i 
ing on T, tended to match all of the sa! 
Premorbid scores. In general, using mie 
numbers and matching will maximize the di 7 
ference between two groups. When the co? 
trols were given a dummy score of unity ae 
the brain-injured a dummy score of zero, t 7 
multiple correlation of the linear discriminat0 
with this dichotomous criterion was .66. å 
To obtain the residual change score, @ an4 
b were calculated, using all 162 control S$‘ 
b = ry 52/5, and a= Ts — bT;. Using the 
obtained values, 6 = .91 and a = 58.05, the 
validity of the residual change score ae 
found to be .61, not significantly differen 
from the multiple correlation. 4 
A further simplification is possible. If 712 F 
sufficiently high and sy is approximately equa 
to sı, then the difference score, D, will havé 
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Table 3 
Descriptive Statistics on Premorbid and Retest Scores 
Xi Xe Brain Injured Plus Controls 

= (N= 128) 

Brain Injured Controls Brain Injured Controls 
Test (N=64) (N=64) (N=64) (N=64) s? se re 
RV 98.4 99.7 82.0 101.6 302.8 472.4 56 
AR 92.8 94.3 77.7 96.2 341.8 393.4 56 
PA 94.7 92.1 85.4 97.1 410.1 407.1 42 
MA 940 95.4 84.3 99.5 256.3 337.1 44 
ACS 84.1 85.9 68.1 90.2 334.9 428.4 52 
aN 464.0 467.4 397.5 4846 4,541.5 7,026.8 37 

— — 


Optimal validity. The correlation of D with 
he dichotomous criterion was .60, almost 
equal to the validity of the residual change 
Score, but significantly lower than the multi- 
Ple correlation, 

; It is clear that either D or Teza could be 
used for discrimination with no practical loss 
n validity. We have chosen to use the residual 
change Score because it has a theoretical aq- 
Vantage as the ratio of controls to brain-in- 
Jured increases, 

. How well does the residual change score 
'Scriminate the brain-injured from the con- 
rols? Unfortunately, there is no single an- 
SWer to this question. If a residual change 
ore of zero is used as a cutoff point, then 
50% of the controls will be correctly classi- 
ed, and 92% of the brain-injured will ie 
Correctly identified, the over-all poster of 
correct classification for the total sample 0 
to being 64, Tf —54 is used as a cutoff point, 
‘E Over-al] percentage of correct classifica non 
'S 85 (the best we have done in this sample) ; 


= the controls, it is 94% correct classifica- 
‘On; for the brain-injured, it is 62% corre 


Classification. 

Jne of the greatest difficulties $ 
Which cutoff rain to use is that, as ag 

S Writers have emphasized (€.8-» ee Care 
$ osen, 1955), usually the percentage 0t of 
Sct classification will shift if the ratio 
Controls to brain-injured is changed in T 
vent samples. However, it is always Poss! ae 
° find a cutoff point such that the percentage 

Correct classification is invariant swith 4 
Dect to changes in base rates. This is Oe 
Point where the percentage of correct classifi- 


in deciding 


cation in one group equals the percentage of 
correct classification in the other group. In 
our study, the cutoff point of equality of mis- 
classification is —33, and it yields, as an in- 
variant, 82% correct classification. This seems 
to be better than the percentage of correct 
classification reported in most studies of brain 
injury. 
Discussion 


Only two previous studies seem to have 
used direct measures of the premorbid intel- 
lectual level in estimating the deficit due to 
brain damage. Canter (1951) found that the 
AGCT scores of 23 multiple sclerotics de- 
creased about three-fourths of a standard de- 
viation. Weinstein and Teuber (1957), using 
the AGCT, indicate that for patients with 
focal gunshot wounds, there is little evidence 
of deficit 10 years after injury. 

The Weinstein-Teuber findings could be in- 
terpreted as evidence that paper-and-pencil 
intelligence tests are not very sensitive to the 
effects of brain injury. Instead, we assume 
there was considerable initial deficit, but that 
the ambulatory patients of the Weinstein- 
Teuber sample regained their intellectual skills 
over a period of 10 years. This interpretation 
has the hopeful implication that brain injury 
need not cause permanent deterioration. Some 
preliminary data we have indicate that, under 
skilled medical care, almost half of the deficit 
may be regained within six months after in- 
jury. This is in general agreement with Wep- 


man’s (1951) results on the effect of training 
brain-injured patients. = 
To many clinical psychologists, the most 


wus t. L. Williams, A, 


surprising result will be that brain injury 
caused as much deficit in the verbal tests as 
in the others. It is commonly believed that 
verbal tests, and in particular vocabulary 
tests, are relatively resistant to brain injury. 
Why should our results differ from those re- 
ported by previous investigators? 

One possible reason is that the RV test, 
which is of the Tecognition type, measures 
factors other than those 
recall vocabulary. The 
in RV require the S to 
a paragraph. Only a minority are standard 
vocabulary items, However, Montague et al. 
(1957) found that in a 
cruits RV had a correla; 
Wechsler-Bellevue Voca 
tion subtests, and a co 
the Wechsler-Belleyue 
since found this same 
tween RV and W-B V; 
ples. (Army enlisted m 
injured patients, V 
RV contains addi 
above that shared 
cabulary, since its 
maining eight W- 


results, together with Yates? (1956) Penetrat- 
ing analysis, should end the myth that verbal 
tests such as Reading and Vocabulary are re- 
sistant to the effects of brain injury, 


Lubin, and C. F., Gieseking 


ne 


The residual change score is an optimal 
discriminator between brain-injured and con- 
trols, no differential weighting of the five 
ACB scores being necessary. 


Summary 


Qualification and classification tests e k 
used as premorbid measures of intelli 
for all patients who have been screened z 
the U. S. Armed Forces. Retests on five 
of the Army Classification Battery furnisne 
direct measures of Cognitive deficit for ir- 
brain-injured patients. The average e A 
ment was about two-thirds of a standard Vo- 
viation. The verbal tests (Reading and Jeri- 
cabulary, Arithmetical Reasoning, and C 
cal Speed) were significantly more sensia 
to brain injury than the spatial tests Cate 
Analysis and Mechanical Aptitude) but c- 
differences were so small as to be of no pra 
tical significance, ients 

A comparison of the brain-injured panad 
with 162 control Ss showed that the simp ia 
way of discriminating controls from ERR 
jured was to use D = Ta — Ta, the sum e- 
the retest scores minus the sum of the p 
morbid scores, Theoretically, the optimal = 
criminator is the residual change score, T 
T2-a-bT; (based on control group Statis a 
but both D and T2.ı have a point-biserial or- 
lidity of about 60 and a percentage of © 
rect classification of about 82. 


Received May 28, 1058, 


REFERENCES 


of 
Barcock, H. An experiment in the measurement | R 
mental deterioration, Arch. Psychol., 1930, No. 

Pp. 105. i s 
Box, G. E. P. Some theorems on quadratic os 
applied in the study of analysis of variance P 
lems. II. Effects of inequality of variance an sifi- 
correlation between errors in the two-way ae 
cation. Ann. math, Statistics, 1954, 25, 484-49: Ee 
Canter, A. H. Direct and indirect measures of Le 

chological deficit in multiple sclerosis: Parts I 

IL. J. gen. Psychol., 1951, 44, 3-25, 27-50. pke 
Fisuer, R. A, Statistical methods for research u 

ers. New York: Stechart, 1941. nic 
Hunt, H. F. A practical clinical test for ET 

brain damage. J, appl. Psychol., 1943, 27, 375-3 ite 
Hoent, J. McV., & Corer, C. N. Psychological dene 

In J. Mev. Hunt, Personality and the beratit 

disorders. New York: Ronald, 1944. Pp. 971-1032- 


| 


ae a ag a SŘ 


Direct Measurement of Cognitive Deficit 


Ken 
eae M. G. Rank correlation methods. London: 
vans Griffin, 1948. 
mur Some formulas for use with suppressor 
296 es. Educ. psychol. Measmt, 1957, 17, 286- 


M 
ae E, & Rosex, A. Antecedent probability 
or cattis efficiency of psychometric signs, patterns, 
N ans scores. Psychol. Bull, 1955, 52, 194-216. 
Re ek E. K, Wittrams, H. L, Lusty, A, & 
Sessme NG; C. The use of Army tests for the as- 
meg rt Of intellectual deficit, U. S. Armed Forces 
BAG Gah tear? 8,:983=892. i 
rese - R. Advanced statistical methods in biometric 

arch, New York: Wiley, 1952. 


305 


Surrey, W. C. A self-administering scale for meas- 
uring intellectual impairment and deterioration. J. 
Psychol., 1940, 9, 371-377. 

Wecuster, D. The measurement of adult intelligence, 
Baltimore: Williams & Wilkins, 1944. 

Wester, S., & Teuser, H. L. Effects of penetrat- 
ing brain injury on intelligence test scores. Science, 


1957, 125, 1036. 
Wepman, J. M. Recovery from aphasia. New York: 


Ronald, 1951. 
Yates, A. J. The use of vocabulary in the meas- 
urement of intellectual deterioration—a review. J. 


ment. Sci. 1956, 102, 409-440. 


. = chology 
Journal of Consulting Psycho 
Vol. 23, No. 4, 1959 


HACH HUMAN 
THE INHIBITION PROCESS, RORSC 
MOVEMENT RESPONSES, AND INTELLIGENCE: 


SOME FURTHER DATA 


MURRAY LEVINE, GEORGE SPIVACK 


Devereux Foundation Institute for Research and Training, 


Devon, Pennsylvania 


AnD BYRON WIGHT 


Veterans Administration Hospital, Coatesville, Pennsylvania 


Rorschach (1942) originally observed that 
the human movement (M) response corre- 
lated with intelligence. Since the 
vestigators have confirmed th 
but the details of the relatio 
ceived scant attention. In pu 
tionship between the inhibit 
vestigated by means of th 
response, and intelligence, th 
undertook a surve 


n many in- 
is relationship, 
nship have re- 
rsuing the rela- 
ion process, in- 
e Rorschach M 


It will be noted there is a striking uniform- 
ity in the magnitude of correlation between M 
and IQ. Across a variety of groups and with 
differing measures of intelligence, the correla- 
tions are generally low, but significant, and 
with the exception of two studies (Altus & 
Thompson, 1949; 1952) only linear relation- 
ships are reported. The median value of the 
M-IQ correlations is .26.2 Second, we noted 

1A 
which 


t, 1937-38; Di 
1951; Palmer, 
& Siegel, 1944; Wittenborn, 1949), 

* Because so few studies 
data, it is not Possible to fully 
of partialling out R on the 
figures are included for th 


e reader's edification in 
Table 1, whenever they cou 


that only one study reported the correlation 
in a population of normal children a 
1934), and that no work has been reporte 

with atypical children. Third, the two studies 
that dealt only with adult ee 
(Singer, Wilensky, & McCraven, 1956; basso 
bee, 1955) both reported correlations re 
Proaching zero. Only in two other insien 
are such very low correlations reported. a 
both cases the populations represented an a i 
tremely narrow IQ range (i.e., “ranking oe 
search scientists” [Roe, 1951] and i 
freshmen, ages 17-19” [Vernon, 19331), 
where attenuation in range would moe 
against significance in correlation. Roe eae 
does report a positive correlation between his 
and a measure of verbal intelligence in t 4 
same group, but the hypothesis that M ae 
primarily to verbal intelligence is not who H 
tenable. Several studies (Consalvi & see 
1957; Holzberg & Belmont, 1952; ra 
et al., 1956; Williams & Lawrence, 1953; 
Wishner, 1948) report the same level of p 
nificant correlations of M with one or abe 
other nonverbal measure of intelligence. bina 
the hypothesis of restriction in range ae 
itself as an explanation for the low corre a 
tions in some instances, the lack of significa 
findings with schizophrenic groups by two } 

dependent investigators (Singer et al., 19 ie 
Taulbee, 1955) is counter to the trend of ! a 
Ports in general and no obvious explanatio 
suggests itself, ok 

With these issues in mind, we underto 


instances, the 


á » the 
present authors are responsible for 
calculations, 
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Groups and References N and Group 1Q Test M-IQ M-R R-IQ M-IQ-R 
Normals 
Ata & Thompson 100 Coll. Stu. Ohio Psychol. Exam = = 
(1952) 19 — — = 
Altus & Thompson 128 Coll. Stu. Ohio Psychol. Exam 4 å = — = 
(1949)» i = = g 
100 Coll. Stu. Verbal Aptitude 37 S = ‘atl 
Consalvi & Canter 45 Adults—M & F, Progressive Matrices a AL A 41 
(1957) Ages 20-36 
W-B Vocab. 42 41 37 32 
Hertz (1934) 300 J. HS Stu. Not stated 6G = s A 
Lotsof (1953) 30 Coll. Stu. Ohio St. Psychol. Exam .20 41 07 19 
Roe (1951) 64 “Ranking Research Specially devised Verbal 92 — gas 32 
Scientists” r 
Spatial 01 =- 05 02 
Math 14 — 07 413 
Vernon (1933)° 25 “Yale Frosh,” Composite score from 
Ages 17-19 several tests 10 — — = 
48 “Harvard Students,” Intelligence Test 
Ages 16-23 Battery 32 — = — 
Out pati 
patients " 
Abrams (1955) 400 Veterans; | WB 360 44335 
psychiat. clinic pts. 
Meltzoff (1956) 803 Veterans; — W-B S ae a 
psychiat. clinic pats. 
Wi y -F W-B a — Ww — 
ishner (1948) 20 Neurotics, M & 
Hessian Ages 16-42 
pOltalized : wB 2 — 6 — 
“tmitage, Greenberg, 503 Veteran psychiat. pts- 
Pearl, Berger, & 
Daston (1955) 
inn 26 — M — 
Beck (1932) 69 “teebleminded,” M&F SB. 
i rp info. 3 å — — a 
Holzberg & Belmont 50 M psychiat. Pts: WB T B= i = 
(1952) W.B pict. compl. i ee 
: ; EE EB =03 41 25 —15 
= bce & 100 Schizophrenic veterans cna 4o A ‘25 ‘At 
raven (1956) 
T : ns WB Not sign. Not sign. 
aulbee (1955)4 60 Schizophrenic vetera 
7 3 = = — 
Tucker (1950) 100 Neurotic veterans W-B 
, . IB Verbal 30 65 Si —.05 
Williams & Lawrence 97 Veterans, psychiat. pts- we erhi 30 65 56  —10 
(953) HAS w aies 
henge i r's of 40 and .19 vectively. 


Sa 


opular M produced 


peated application of the tests to the 


ae 


‘ a 
G 

r Grou Rorschach; M mi r 

e aro P Rorschach; value of .31 is 

ayro used. ; 

S Not reported, but were obvious! 


M and Pe 
d on a rel 


ly calculated. 


ne population. 
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the present study. First, we were interested in 
seeing whether roughly the same magnitude 
of correlation between M and IQ would hold 
in a group of abnormal adolescents, thus help- 
ing to fill in one gap in the current literature. 
Second, in light of the bulk of evidence for a 
positive M-IQ correlation, we wished to see 
whether we could confirm the negative find- 
ings of Singer et al. (1956) and Taulbee 
(1955) with hospitalized schizophrenics. This 
seemed important for the insight it might 
afford into the M-IQ relationship. Third, we 
were interested in attempting to confirm with 
different populations a previous finding that 
the error of reversing the mirror-image N; 
symbol for the number two in the W-B 
Form I digit symbol subtest, is related to 
general intelligence and to M, In earlier work 
(Levine, Glass, & Meltzoff, 1957) the reversal 
error has been described as a function of the 
insufficient delay or control o 
to write the normal 


Subjects 


The study included: 


TISS adolescents, both sexes, residents at 


tions of childhood (23%); IQ range, 41 135 
3 Ti ? 


Page ale, hospitalized 
with diagnoses of schizophrenia - e ans, 


145, normally distributed. bE 

on Cae adult, male, hospitalized vet 
a psychotic diagnosis other than sı 
(25%), neurotic 
(39%), and chronic þr. 
IQ range 55-135, norr 

4, 132 adult, male, 
ans with diagnoses of 


erans with 
chizophrenia 
Personality disorders 
ain syndrome (36%); 
mally distributed, i 
outpatient clinic veter- 
schizophrenia (17%), 
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neurotic and personality disorders (56%), 
and chronic brain syndrome (27%); IQ 
range 63-138, normally distributed. 


Procedure 


In all cases the values for M, R, and IQ 
were obtained from the clinical files of the 
respective institutions. The scoring of the 
original examiner was accepted in all in- 
stances. The Rorschach and the test of in- 
telligence were administered individually, and 
a record was not accepted for the study if 
more than one week elapsed between the ad- 
ministration of the two tests. In our adult 
populations, and with most of the adolescents, 
the intelligence test used was the Wechsler- 
Bellevue Intelligence Scale, Form I. The re- 
mainder of the IQs were obtained from the 
Wechsler Intelligence Scale for Children 
(WISC). The IQ score used was always the 
full scale IQ. However, in many instances, 
the score represented a prorated value, rather 
than a value based on 10 subtests, since many 
clinicians administered only a short form of 
the test. This is not felt to be any great diffi- 
culty, since the correlation between almost 
any short form and the score derived from 
the full scale is very high. 

The measure of intelligence test perform- 
ance failure was the presence of one or more 
reversals of the mirror-image M, symbol 1 
the number two in the W-B, Form I digit 
symbol subtest. The appropriate subtest, oF 
the particular form of the W-B, was not ad- 
ministered to all Ss, so data are not available 
on this point for all Ss. However, we have nO 
reason to expect any systematic selection of 
Ss for whom the subtest was omitted. 


Results 


The correlations between M and TQ for the 
various populations we studied are presente 
in Table 2, 

Our findings show low but significant col 
relations in each of the four populations 

tudied. It will be noted that several of the 
Correlations are based on populations whic 
are heterogeneous for diagnosis. In the adult 
Populations, there is no significant differenc® 
in M production between organics and othe! 
diagnoses. In the adolescent population, t 

median value of M increases as we moV 


cll eg 


A te E a 
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Table 2 
Some Further Correlations Among M, Wechsler IQ, and R 
Group N M-IQ M-R R-IQ M-IQ-R 
Hospitalized schizophrenic veterans 209 a7 .62 ;23 30 
Hospitalized veterans, nonschizophrenic 91 49 45 31 Al 
Veterans pts, psychiat. clinic 133 Al .60 41 .23 
155 -20 AS .19* .18* 


Adolescents, residential school, all diagnoses, M & F 


Renan 
Significant at p= <.05 >.01; all other 7's are significant at $ <.01. 


from the diagnosis of chronic brain syndrome, 
through schizophrenia and then to emotional 
and personality disorders. However within 
each of these groups, when examined sepa- 
rately, those with more M had higher IQs 
than those with fewer M. We therefore do 
not feel that the M/-IQ correlation in the 
group of atypical adolescents as a whole 
Can be attributed to the heterogeneity of the 
Population, In keeping with previous findings, 
there is apparently a more or less consistent 
relationship between M and IQ across almost 
any population. 
_ Tt will be noted that a significant correla- 
tion is obtained in the group of adult, hos- 
Pitalized schizophrenics. In fact, the figure of 
7 is well above the median value of .26 of 
all other investigations summarized in Table 1. 
he data depicting the relationship between 
M and reversals of the digit symbol subtest 
mirror-image N are presented in Table 3. 
e data in Table 3 are based only upon 
ose Ss for whom evidence of reversal or 
Nonreversal of the mirror-image V was avail- 
le. For the adult hospitalized group, ta 
O reverse the mirror-image V have signi 


cantly fewer M than those who do not make 
this error. The finding continues to hold when 
R is controlled. In the adolescent group, re- 
versers do not produce significantly fewer M 
than do nonreversers, but the direction of the 
slight differences in percentage is consistent 
with current and previous findings with adults. 

Since the prior study (Levine et al., 1957) 
with adult outpatients found a significantly 
higher IQ for nonreversers, a similar compari- 
son was made in our present populations. In 
the present adult population of hospitalized 
patients, the prior observation is confirmed. 
Nonreversers had a mean IQ of 101.3 (e = 
16.1), whereas reversers had a mean IQ of 
93.5 (o = 17.5). This difference is significant 
well below the .01 level of confidence. In the 
adolescent population, the mean IQ of non- 
reversers was 98.9 (s = 17.4) and the mean 
IQ for the reversers was 91.7 (o = 20.6). This 
difference approached significance at the .15 


level of confidence. 
Discussion 


All of the obtained correlations between M 
and IQ are consistent with results obtained by 


Table 3 


f Reversers and Controls Showing Less Than Two M, Adjusted for R 
Percentage of Ke af 
— 
= Adolescents 
All Adult Inpatients* 
Controls Reversers Controls 
‘ontr . 
Reversers 
% N % t N % N % b 
R N o 
56.7 57 47.4 = 
Xi s a oP on wets E 
ren et a es Aes ADS: | (82 «| Sha e 
<19 32 ae 2 403 M 1 S 5 
72. 
= = d 91 nonschizophrenic hospitalized patients who were administered the 
enics ani z 


h Thi izophr 
Telee bis group is drawn from the 209 schizop 
ant subtest. 
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others on a variety of populations. The addi- 
tion of the group of atypical adolescents adds 
one more link in the chain, and extends our 
ability to generalize about the M-IQ rela- 
tionship. The consistency of correlation sug- 
gests a consistency of process in any popu- 
lation. 

The significant correlation between m and 
IQ in our adult, schizophrenic, hospitalized 
group is in keeping with the general trend of 
past reports in other populations, and it fails 
to support findings reported by Singer et al. 
(1956) and Taulbee (1955). These authors, 
contrary to the general trend of past reports, 
found near zero correlations between M and 
IQ in groups of schizophrenics. We can see 
no obvious explanation for the discrepancy 
between our findings and theirs. In all three 
instances the patient populations were highly 
similar, and the samples sufficiently large. 
We can only suggest that weight of further 
evidence be called upon to settle the question 
as it concerns schizophrenics, 

If the weight of future evidence supports 
our findings with schizophrenics, then the 
reliability of the specific result, and to some 
extent the factor analysis of Singer et al. 
(1956), would become questionable. Along 
this line we might note that Singer et al. did 
not draw an “intellectual factor” from their 
matrix of intercorrelations despite the fact 
that their variables included R, M, C’, IQ, 
and Porteus mazes. Singer’s group did report 
a significant correlation between M and 


Porteus IQ. The fact that they did not draw 
an intellectual f 


least three other 
Canter, 1957; 
Lawrence, 


intellectual 
, and C’ among other 
e wonder whether the 
ors found by Singer 
an intellectual factor 
e specific relationship 
ved to be different in 


same set of four fact 
would be drawn out if 
were produced, or if th 
between M and IQ pro 
a new population of schizophrenics, It may 
eventually prove to be the case, as Taulbee 
(1955) suggests, that we cannot expect the 
same relationships between Personality and 
intelligence to hold in schizophrenics. How- 
ever, a great deal more evidence than that 
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currently available would have to be mate 
shalled to demonstrate the point. The ee 
to repeat the zero correlation between M an 
IQ reported by Singer does not in any wey 
detract from Singer’s other experimental re 
sults or theorizing. d 
Earlier work (Levine et al., 1957) presente 
the theory that the reversal of the mirror-1m- 
age N was a manifestation of poor aoa e 
inhibit or delay responses. Our finding Wi n 
the adult hospitalized patients, that reverer 
have less M and lower IQs than nonreversers; 
duplicates prior results closely. It would oe 
that adequate functioning of a delay mec p 
nism is an important element in CnTEE DR 
good score on the intelligence test as a ae 
Both present findings and prior work in a 
cate that the relationship between intelligent 
test performance and inhibition process m 
measured by M, holds in an adult populani 
irrespective of the degree of illness, as in 
cated by hospitalized or outpatient status. 
The reversal data in adolescents, wage 
presents a somewhat differing picture. A a 
lescents who tend to reverse the mirarina 
N have a lower mean IQ (as with adiis i 
However, the tendency to reverse does ak 
seem to be related to Rorschach M (as it 
related in adults), even though M and to 
are significantly correlated. This ae 
replicate the reversal— relationship in “itt 
lescents cannot be ascribed to the unreliability 
of the relationship, since the finding prov ä 
stable with adults. One conclusion that al 
tentatively be formulated is that 37 does pe. 
have exactly the same significance with a 
gard to the delay function in adolescents a 
in adults. This possibility becomes more rd 
gent in light of Litwin’s (1957) failure to a 
peat important aspects of work on M fie 
various forms of inhibition by Singer, Me Be 
off, and others (Levine & Meltzoff, 1956; 
Meltzoff & Levine, 1954; Meltzoff & sp 
1956; Meltzoff, Singer, & Korchin, 1953; 
Singer & Herman, 1954; Singer, “arn 
& Goldman, 1953; Singer & Opler, 195 $ 
Singer & Spohn, 1954) when she studied in 
hibition variables in younger age groups. +t 
The present outcomes and survey of pas 
work emphasize the relationship between 4 
personality variable, the delay function of the 
ego, measured by M, and general intelligence- 


i N’, 
CO 


Rorschach Mo 


It 
a ea ar that the inhibition process bears 
z pes hip to intelligence test performance. 
relates to ae the question whether inhibition 
in ways e level of intellectual development 
not allies subtle than simply making or 
research AE ag errors remains for future 
Personalit IENEN (1957), also working în a 
that the y oriented framework, demonstrated 
characte independently measured personality 
ateq ges of “suspiciousness” Was corre- 
te features of intelligence test per 
Many ha and with the level of intelligence. 
ies het ave emphasized the closely entangled 
kea oh personality and intelligence, but 
intellect, these have been treated as “non- 
ing use ive” factors of intelligence. By mak- 
Y the of the theoretical framework provided 
emptied oe of ego functions, as “ 
chafe in the work of Rapaport, Gill, an 
Marsch (1945) and Fromm, Hartman, an 
Dossib] ak (1954) with children, it may be 
elligens eventually to relate concepts, of in- 
Single nce and intelligent behavior within a 
theoretical framework. 


Summary 
a median value of .26 was found in a sut- 
No aE studies reporting M-IQ correlations. 
5 ja aies were found dealing with atypicn 
Schi en, and two studies dealing with adu 
izophrenics reported near zero correlations 


etween M 
en M and IQ. s MIQ orda 


he 
ti present study repor 
ons for a group at atypica hildren (.20): 
(at) itpatient veterans 


ann of psychiatric ov 
Schizophre psychiatrically hosp 
Pitali; phrenic veterans (-49)> o = 
on ra schizophrenic veterans 37): Da 
mir relationship between reversals 3 is 
tee eee N of the W-B digit symbo a 
nt Rorschach M, and IQ are also reporte 4 
dae group of hospitalized adults, it was 
fer Wn that reversers and nonreversers i 

Rot Ai both M and IQ. 
children, confirmed in the grou 
an suggested that a t! nape 
chol ing measures of intelligence to the psy- 
vid logy of ego functions may eventually pro 
in € a framework to understand concepts 0 
telligence and personality in the same terms. 


Received May 28, 1958. 
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fe tries to answer the question: 
tests pr i tine nageananndi and the Rorschach 
sive ive “i the outcome of long-term inten- 
tients? otherapy with very sick mental pa- 
eae of empirical studies have been 
apy (Win: predicting response to psychother- 
cal te indle, 1952) by means of psychologi- 
Bloch In most cases, the patients were 
2 ie votig; the psychotherapy was brief 
of ae longer than six months), and length 
Was H in psychotherapy rather than outcome 
agree he criterion. As yet there is no general 
In ment on the basic factors in prognosis. 
gel (10 detailed study of the Rorschach, Sie- 
ick. 948) found only three prognostic signs. 
not TA (1949) found more, but his signs © 
I gree with those of Siegel. 
i aud and Gottlieb (1942) found that 
neur Binet scores made it more 
ut otics would benefit from psychotherapy, 
n trend did not reach the -05 level © 
ar mo Miles et al. (1951) found a simi- 
ell ut significant result using the Wechat 
ou evue. On the other hand, Dickson (194 ) 
nd no evidence that IQ was prognostic. 
me examples are characteristic of mi 
les ies. Windle (1952) reports some o stud- 
» Covering a wide variety of therapies, in 
n ich cognitive tests were used as predictors. 
One third of them, the intelligent patients 
ere more likely to improve; in another third 
e opposite was true; the remaining third 


s 
howed no significant relation- Tt seems then 
been demon- 


ay no consistent relation has 
noes between intellectual level and the re- 
ts of psychiatric therapy. 


The present study was conducted at Chest- 


likely that- 


Institute of Research, Washington, D. C. 


nut Lodge, Inc., a private hospital of about 
100 beds, devoted to psychotherapy. It is 
important to describe the milieu since it is 
unique. No shock or psychosurgical treat- 
ments are used at this hospital. Well over 
half the patients are schizophrenics, many of 
whom have been hospitalized for years be- 
fore coming to Chestnut Lodge. Socioeconomic 
status and intellectual level tend to be high 
Every patient is seen regularly by an Pie 
lytically trained psychiatrist, usually four 
hours a week. The basic philosophy of the 
hospital includes the assumptions that pa- 
tients may require years of hospital treat- 
ment; that they probably will continue in 
therapy after leaving the hospital, often for 
several years; and that all patients, no mat- 
ter how deeply psychotic, can recover. 

The high economic status of the patients 
the long intensive psychoanalytic thera | 
and the general hospital milieu make this 
sample a homogeneous group of mental a 
tients of a type never studied before tom, 
prognostic point of view. 3 


Method 
Subjects 


The Ss of this study wer 
e all i 
who met the following eohditierie! uae 
a. A Rorschach was gj ‘ 
given at 
Lodge, or a Rorschach protocol pike eae 
the six months prior to admission w. il. 
2a as avail- 
b. The patient was in treatment at Chest- 
nut Lodge at least two years folowing ad 
ministration of the test. This is ‘monet 
because the main purpose of this study is to 
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314 


answer the question whether tests have prog- 
nostic significance, and the prognosis must be 
made, of course, from the time of testing for- 
ward. 

c. The patient did not have any known 
brain damage. 

d. One of the patient’s treatment years 
postdated January 1, 1950, and all the re- 
quirements listed above were fulfilled by Oc- 
tober 1, 1955. No information following that 
date was used. 

Ninety-three patients (40 males and 53 fe- 
males) fulfilled all the conditions. The me- 
dian age of the males was 26 and of the fe- 
males, 28, with a range from 16 to 53. Table 1 


gives their distribution according to diagnostic 
category. 


Criterion 


The really difficult part of any prognostic 
study is to define precisely (a) what one is 
trying to predict, and (b) for what time one 
is trying to predict it. 
a. No attempt is made in this paper to pre- 
dict Personality change per se, or any of the 
psychological conditions usually conceived of 
as desirable end-states in Psychotherapy. Only 
the patient’s social adjustment, as shown by 
where he lived, was considered. The most im- 
portant distinction js whether the patient was 
in or out of a mental hospital. If he was ina 
hospital, was he on a disturbed ward or a 
Convalescent ward? If he Was out of a hos- 
pital, was he an outpatient, a private patient, 


Table 1 
Psychiatric Classification of Pa 


a tients Used 
in This Study 


Diagnoses 


N 
Schizophrenia, paranoid type 43 
Schizophrenia, catatonic type 10 
Schizophrenia, hebephrenic type 6 
Schizophrenia, simple type 1 
Schizophrenia, other types 10 
Manic depressive psychosis 2 
Schizoid personality 1 
Psychopathic personality 2 
Personality disorder 2 
Psychoneurosis 16 
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or was no treatment needed? Changes from 
one such status to another constituted our 
criterion of improvement. Graphs were er 
for each patient showing his status for eac 
day using the following status scores: 


: Disturbed ward 
Semi-disturbed ward 
: Convalescent ward 

: Outpatient 

: Private patient 

: No treatment needed 


b. Whether a patient seems to do well A 
poorly depends upon the period of time on 
which he is observed, The term “final es 
come” is either meaningless or misleading 6 
Psychiatry. Does it refer to the patient's we 
of mental health at the time of his deat A 
Any other point in his life has to be ee 
arbitrarily and is often followed as well i 
preceded by considerable change for the ber 
ter or for the worse, A study of the ieue, : 
therapy should, therefore, include a descr < 
tion of the patient’s course for a stated 
tiod of time and whether it is upward ly. 
downward, or upward and downward. oen 
no simple function of the status scores e 
represent adequately a patient’s course. e 
fore, 11 categories were set up which form 
the social adjustment criterion. me; 

Category 11 denotes the best er 
Category 1 denotes the worst. (The num in 
in brackets refer to the number of patients 
the category.) 


Oe we on 


Y 
ý , as neve’ 
11. All scores between 0 and 1, ie., patient wa 


hospitalized [2]. to 108 
10. Scores begin at 3 or more and are down t starts 
less by the end of 1 year, ie., the ean rOl 
in the hospital, improves consistently an 
of the hospital by the end of 1 year [9]. x 
9. Scores begin at 3 or more, are down to l the 
by the end of 1 year, as in Category 10, 
decrease is inconsistent, up and down [0]. ri 
8. Scores begin at 3 or more, are down to 1 S the 
between the end of the first and the end 0 italy 
third years, i.e., the patient starts in the Bose d 
improves consistently, but more slowly and ‘il: 
of the hospital by the end of the third year Jess 
7. Scores begin at 3 or more, are down to 1 Be the 
between the end of the first and the end 0 is 
third year, as in Category 8, but the decrease 
inconsistent, up and down [6], or 
6. Scores begin at 3 or more and are down to 1 ee 
less after the end of 3 years, i.e., the patient stat 
in the hospital, improves consistently but very 


less 


jess 


Social Adjustment Under Psychotherapy 


eel and is not out of the hospital until after 
Sere ee mas lal. 

less “| at at 3 or more and are down to 1 or 

fur sa : e end of three years, as in Category 6 

io}. decrease is inconsistent, up and down 
4. . 

e rn at 3 or more; there is no steady de- 
en fa the monthly averages are 1.6 or less 
course SRSL 3 months at the end, ie„ patient's 
Ward fie inconsistent, but there is a trend to- 
Scores provement at the end of the period [7]. 
decreas cgin at 3 or more. There is no steady 
no t S ie., patient’s course is inconsistent with 

trend toward improvement at the end of the 
penia [22]. 

Say do hot go below 3, but ] 

ùt ae pona remains consistently hospital 
Cores a y on a convalescent ward [7]. . 
Part hi i not go below 3 and are for the most 
sistentie er than 3, ie, the patient remains con- 
16] y hospitalized, chiefly on a disturbed ward 


a 


rarely go higher, 
ized 


jae psychologists made independent clas- 
T with almost perfect agreement. 
Place, ‘five per cent of all patients = 
Taters.1 in the same category by all three 
avaliable information on the patient was 
lable for periods of two to nine years. 
T is not necessarily all time in treatment, 
inor oly time over which there 1s reliable 
our mation, The patients were divided into 
duri groups according to the length of time 
"ng which information was available about 

į ™ after the testing date. (The distribution 


1S given in Table 3.) 


Predict; 
| ediction Measures 


A 
| Wechsler-Bellevue Adult Scale of Intelli- 
I or I, 


8ence. A W Form 

had Wechsler-Bellevue, Form S 
eer creda o of the 93 9S 

close administered to 9 ion of the 


o to the time of the administrat i 
rschach. Only the Full Scale 1Q, calculate 
in ae basis of at least 10 subtests, was US? 
Is study. 
te Rorschach. Preliminary studie: 
e ion of particular Rorschach 
ing reaped clinical courses were 
the a senior author, therefore, 
ab ollowing broad descriptive $ 
Out good signs and poor signs in t 
d L. Williams, 


d Social Psy- 
rch, 


s on the cor- 
factors with 
unpromis- 
developed 
tatements 
he test: 


1 
Gn authors are indebted to Harol 
b a of the Department of Clinical an 
ology, Walter Reed Army Institute of Resea 
Or help in this classification. 


Good Signs 


1. Patient goes at the test competently, This may 
be shown in a variety of ways, ¢.g.: A 
a. He gives a large number of R which are not 
simply empty perseverations or repetitions of 

his preoccupations, but are of good quality. 

b. He does not hesitate a great deal, but is fairly 
speedy in his productions. g 
He speaks as if he knows what he is talking 
about. 

He shows interest, alertness, and/or enjoys the 


d. 
task, and/or shows some humor (not of the 


unconscious variety). 

2. The patient’s test does not show clear evidence 
of manifest psychosis. It might be diagnosed neu- 
rosis (hysteric or obsessional), schizoid, or latent 
schizophrenia. Mild psychosis is in between good 


and bad. 
a. As a corollary of this there is a good number 


of P. 

3. The content is lively, imaginative, varied, origi- 
nal. Dysphoric, morbid content is not the best but is 
much better than dull content. 

4. There is good movement, color, shading, but 
particularly good M. 

5. The patient seems to be intelligent and able to 
function intelligently at present. This may seem to 
be the same as the points above, but any additional 


evidence of it is a good sign. 


Poor Signs 


1. Patient shows signs of incompetence in fulfilling 


k. This may be shown in a variety of ways, 


the tas 


eg.: 
a. He gives a meager quantity of R. 

b. He rejects one or more cards. 

He takes an inordinately long time. 

He expresses or shows extreme fatigue, disin- 

terest, restlessness or the like. 

. He is very uncertain of what he perceives. Try 
to distinguish this from the neurotic’s uncer- 
tainty about whether he is pleasing the ex- 


T 
d. 


aminer. 

2. The patient shows clear signs of overt psychosis. 
This is especially bad if the signs are so clear that a 
person who is not a Rorschach expert, reading the 
protocol, could identify it as a psychotic production 
simply from the verbalizations. It is also bad if the 
Rorschach worker finds the diagnosis of overt psy 
chosis easy to make on a casual skimming af te 
protocol. The easier the diagnosis, th 
i » the worse the 

a. As a corollary of this there is low P 


3. The content of the record i 
| is d 7, 
e ull, empty, re- 
4. There is little movement, color, or shading 
5. The patient seems to be either of poor intellec- 
tual endowment or shows at present gross intellec 
tual impairment. eee 
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SOCIAL ADJUSTMENT vs W-B IQ 


O=FEMALE 
X = MALE 
N=90 


SOCIAL ADJUSTMENT 


50 
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Fig. 1. 


The statements were given to two experi- 
enced Rorschach workers,* together with the 
Rorschach protocols of the 19 patients in 
Group D (7-9 years of follow-up). They had 
no information about the patients other than 
age and sex. When it was found that their in- 
dependent global ratings had substantial cor- 
relations with each other and with the social 
adjustment criterion, all 93 Rorschach pro- 
tocols were turned over to a competent but 
relatively inexperienced clinical psychologist. 
Eight protocols were used for practice and 
training, leaving a total of 85 protocols for 
scoring according to the “good and poor 


signs.” A high Score meant a predominance 
of good signs and vice versa. 


Results 


Figure 1 shows the relati 
ment to the W-B intelligen 
is not a bivariate normal 
the triangular or fan sh 


in psychological studies. Although not given 
here, the plot of social adjustment against the 


*The authors are indebted to Margaret Thaler 
Singer and Nathene Loveland, Department of Clini- 


cal and Social Psychology, Walter Reed Army Insti- 
tute of Research. 


3 The authors are indebted to Eugene Sta: 
Department of Psychology, St. Elizabeth's 


on of social adjust- 
ce score. Clearly, it 
distribution, but is 
ape frequently met 


mmeyer, 
Hospital, 


Rorschach rankings showed the same her 
scedasticity. Figure 1 shows clearly that T 
curacy of prediction from Wechsler ie an 
creases as the IQ decreases. For Ss wit so 
earned IQ higher than 110, the prediction ia 
social adjustment are no more accurate 
would be obtained by chance. 

For the males, the correlation of wr E 
with social adjustment is .50, and for t ela- 
males is .55. For the total group the corr! 
tion is .52. Because of heteroscedasticity; le. 
usual tests of significance were not get 
Various rank-order and chi-square tests sho 
that the relation was significant. 


Table 2 


x Rat- 
Intercorrelations of Social Adjustment, Ronee 
ings, and Intelligence for Patients with 7-9 Yea 
of Treatment Plus Follow-up Time 


WV 
MN E ¥ 
Ratings by Rorschach workers 
Experienced M 
Experienced N 85 
Inexperienced B73. 84 
ler-Bellevue IQ _ W .79 67 152 
exe iit criterion C .75 76 "75 (69 


sore 


i 


T 
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Table 3 
N eorrelations of Social Adjustment, Intelligence, and Rorschach Rating by Follow-up Group 
x Wechsler IQ 
Gro Treatment Plus 
up Follow-up Time N te fer Tew Reew Mean Variance 

a 2 Years 17 st 26 14 54 112 408 

a 3-4 Years 18 —05 —.16 —.04 17 119 67 

D 5-6 Years 31 44 65 -64 65 105 442 

7-9 Years 19 75 69 52 83 113 246 

85 

Note-—c is the social adjustment criterion, € is the Rorschach rating, and w is the Wechsler 10; Reew is the multiple correlation of 


the eri 
Criteris x 
ion with the Rorschach and Wechsler. 


et morbid W-B IQ was estimated on the 
Com, of the W-B protocol. A deficit score was 
the hie by subtracting the earned 1Q from 
ad. mated IQ. This index of deterioration 
justm correlation of about .50 with social ad- 
“iil the same as the earned IQ. a 
Rors E 2 gives the results of applying the 
chach global rating, described previously, 
fol roup D (7-9 years of treatment plus 
Te sue time). 
Schach ns that the two experienced Ror- 
not guy orkers produce higher correlations, 
e only with each other but also with the 
‘cctsler IQ, than did the inexperienced cli- 


Nician, 

Dee 3 tries to answer several questione 
as foll he predictability of the criterion c ange 
the Rep time increases? Will joint ane OF 

Tove orschach rating and Wechsler IQ i 
Ve prediction over use as individual scores? 
Dredi Seems to be no systematic change in 
zero ictability as follow-up time increases. Tie 
se order correlations make it clear pes 4 
a and the Wechsler predict wit! i; 

io equal accuracy. The multiple corre 
Ci indicate that a linear combination does 
improve the prognosis significant y- 
ment Table 3, Sane B (3-4 years of pou 
"he plus follow-up time) obviously differs 
a the others in that all correlations are 
aa zero, But essentially this situation does 
differ from that in other gtouP®, for in 
‘oup B there is just one S with an 1Q lower 
such 110, and Fig. 1 shows that it is only for 
Ss that accurate prediction can be made. 
© lowered variance on the Wechsler thus 


seems to account for the near zero correla- 


tions. 
Discussion 

The most striking and practically useful 
finding in this study is that the tests, as used 
here, do not predict social adjustment for pa- 
tients who do well on the psychological tests, 
put do predict with virtual certainty for those 
who do poorly. Whether this poor perform- 
ance is a function of inferior native endow- 
ment or the result of so-called psychotic de- 
terioration or a combination of the two, is a 
question which cannot be answered from this 
study. 

In practice, the clinician utilizing long-term 
intensive psychotherapy with very sick men- 
tal patients will be confronted with two types: 
(a) those whose intellectual functioning is 
relatively intact; who approach a task in- 
volving creative imagination with alert com- 
petence; and who, if they are psychotic, still 
maintain “clear” areas, and (b) those who 
show obvious intellectual impairment and ob- 
vious all-pervasive psychosis, whose produc- 
tions are meager, dull, and repetitive. The pa- 
tients in the first group may or may nat 
recover. The factors which lead to recovery 
could not be identified in this study. 

The patients in the second group did not 
recover. The possibility cannot be excluded 
that continuing treatment over a still longer 

eriod of years may produce better results 
but the conclusion remains that such results 
occur only when the effort is enormous and 
the case is exceptional. All of these patients 
were schizophrenics; their characteristics are 
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- 
like those which have been described in the 
literature as process schizophrenia. The cli- 
nician must ask himself whether psychother- 
apy, as it is now conceived, is really the 
method of choice with these patients since 
the results over such a long period of time 
are so meager. 

Since no consistent relation has been dem- 
onstrated between intellectual level and out- 
come when all types of therapy are considered 
together (Windle, 1952), the high prognostic 
accuracy in this study for patients with low 
intelligence is probably linked to the kind of 
patient, the kind of milieu, and the kind of 
psychotherapy administered. 


Summary 
Ninety-three patients undergoing intensive 
psychotherapy for at least two years were 
given psychological tests and followed for ad- 
ditional periods up to seven years. Either the 
Wechsler-Bellevue or the Rorschach could be 
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used to predict the patient’s course with a 
validity of about .50: combining the two did 
hot improve prediction. A prognosis of non- 
improvement could be made with virtual cet 
tainty on the basis of poor test performance, 
but good test performance was not prognostic: 
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MMPI L-F-K RELATIONSHIPS WITH CRITERIA OF 
BEHAVIORAL DISTURBANCE AND SOCIAL 


ADJUS 


TMENT IN A SCHIZOPHRENIC 
POPULATION 


LEONARD R. GROSS + 


Veterans Administration Hospital, Ro 


Th ree 
the ioe years there has been a change in 
Phasic ei usage of the Minnesota Multi- 
idity se ing acd Inventory (MMPI) va- 
terpretat; les. Since the advent of pattern m- 
Scales oa te the original use of the L-F-K 
as e a of test-taking attitudes 
Variables as a to deal with such personality 
Macy af as self-concept, reality-testing, ade- 
D disturba social behavior, degree of behavioral 
nisms, nce, and general adjustment mecha- 
sug ination of data from various studies 
ioral a that F is positively related to behav- 
Iggy, een (Gough, 1946; Schmidt, 
téng chiele and Brozeck (1948) report that 
nds to increase with severity of disturb- 


ane . 7 
a ce following semistarvation. Gough (1950) 


indi 
Xates that Ss attempting to present them- 
F and low K, 


Sely, 
ane F disturbed have a high ¥ § vK, 
ave S told to make a “good impressiot 
(1957) high K and L. Dragow and Barnet e 
eir ; report that Ss motivated to anaes 
Vane Capabilities as employees worthy of ad- 
ement had a high K and low Pe 
the r purpose of this study is t°, gee 
With elationships among the validity scale: 
. “egard to some personality variables. 
is exploratory, only two 
utilizing current 
he original logic 


basic Ir this study 

clini hypotheses were made, 

of cal practice as well as t 
the scales: 

ee Ss relatively nonbeha 
e L SF, K >F (a “V” shape). 


his indebted- 
in planning 


viorally disturbed 


1 
ye author wishes to acknowledge 
Š ne William J. Eichman for his al 
and pa and to Burke M. Smith, Earl- 
Af oy A. Eck for their critical reading © ay 
aes luscript. ‘Thanks also to the Medical IIlustratic 
Vice for making the graphs. 


anoke, Virginia 


2. Ss severely behaviorally disturbed have 
F>L,F>K (a “caret” shape). 


Method 


A group of 100 newly admitted psychiatric 
patients, 50 males and 50 females with a pri- 
mary diagnosis of schizophrenia, who were 
given the MMPI during the first month after 
admission, were selected as Ss. Patients over 
60 years of age or with a history of organic 
brain damage were excluded. 

The mean age of the male Ss was 33 years, 
with a range from 22 to 55. The mean age of 
the female Ss was 34 years, with a range from 
21 to 51. The mean education of the male Ss 
was 11.6 years and of the females 11.8, For 
the males, the subclassifications of schizo- 
phrenic reactions were: 1 catatonic, 20 para- 
noid, 1 affective, 28 undifferentiated. For the 
females the subclassifications of schizophrenic 
reactions were: 2 catatonic, 1 hebephrenic 
18 paranoid, 4 affective, 25 undifferentiated. 
There were no significant differences in any 
of the above between sex groups. 

The Ss were rated by the investigator on 
scales of behavioral disturbance (BD) and 
social adjustment (SA). The scales suffer 
from the fact that they had to be formulated 
to deal with existing clinical record data. BD 
was determined by rating the S as —1 0 
+1 on 9 categories with a score of ss ae 
in the disturbed direction. The general eing 
gories were ward adjustment, obvi ee 
ioral manifestations of psychosi ous behav- 

ychosis, and therapy 


table giving the co: 

: le g g mplete scales has 

posited with the American Documentation i i 
Order Document No. 5888, remitting $1.25 for eiii 
film or $1.25 for photocopies. T 
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Table 1 


Analysis of Variance of L-F-K Relationships with 
Mild and Severe Behavioral Disturbances and 
with Male and Female Schizophrenics 


Leonard R, Gross 


Table 2 


Analysis of Variance of L-F-K Retest a 
Good and Poor Social Adjustment and wit 
Male and Female Schizophrenics 


Mean Mean 
Source df Square Source df Square 
Between Subjects 99 102.59 Between Subjects 99 102.59 
Behavioral disturbances 216.75 Social Adjustment 1 E 
Sex 1 234.47 Sex 1 BH 
BDXS 1 99.38 SAXS 1 a 
Error (b) 96 100.51 Error (b) 96 100.2 
Within Subjects 200 133.36 Within Subjects 200 aa $ 
Validity scales 2 617.10* Validity Scale: 2 617.1 
VX BD 2 1,418.57% vxsa 0S 2 50.08 
VXS 2 27.43 VXS 2 ie 
VXBDxs 2 214.33 VXSAXS 2 971.20 
Error (w) 192 115.18 Error (w) 192 12183 
Total 299 Total 299 
* F significant at O01, 


** F significant at 001, 


SA criterion 


L K 
70 z 
~ Severe BD, 
~~ -Mid BO RM EF 
2 
& 60 
= 


50 


Fig. 1. Mild and severe BD groups on the MMPI 
validity scales. 


* F significant at .01, 
** F significant at .001, 


«ance 
Type I two-dimensional analysis of var 
designs as recommended by Lindquist (1 


Results 


«ance 
A three-dimensional analysis of varia 
Was done which included the varia 
(a) mild and severe BD, (b) Sex, and aly- 
the Validity scales. The results of this ané n, 
sis are presented in Table 1. In this an E 
the variables of BD and Sex, taken ale 
ave no psychological meaning, eee 
Scores dealt with are summations of t e is 
Scores across L-K—F scales. Likewise, hity 
little interest in the effect of the va die 
scales taken alone. In this case, the Vali ly- 
scale’s effect is significant, and further ana 
Sis indicates that for the total sample F 7 


EE 
——— 


70 


60 


T Score 


50 
Fig. 2. Good 


and poor SA groups on the MMPI 
validity scales, 


— 


MMPI and Disturbance or Social Adjustment 


Sr FK ti F K m 
nL! 
H | : 60_| 
k- k o 
Ez — '50°| 


— Goog Sa havens 
A) 


E: 2 
Por SA tevere BOM+F 


Lal ) i 
Fi 

'& 3. SA and BD profile combinations on the 
MMPI validity scales. 


-= + M 
Good SA} SevereBO 


k 


ae This is to be expected in a schizo- 
GTA sample. Prime interest lies in the in- 
with ions of the Validity scales with Sex and 
trip] BD or with both. In this analysis the 
a4 © interaction is not significant, and there 
of fe significant interactions with the = 
Sey e Ss. The difference between mild an 
nifem BD for the Validity scales was sig- 
re Cant beyond the .001 level. Figure 1 rep- 

sents this significant interaction. Hypothe- 


sis I, that i id BD have L>F, 
rs’ Ss with mil DL, that 8 


.> F, is confirmed. Hypothesi 
With severe BD have F > L, F> K, is also 
Confirmed, 

An identic i iance design for 
al analysis of varian ign 

SA and the three validity scales also yields 

Wo significant F ratios, one for the validity 


a €s beyond .01 as in BD and the other a 
riple interaction among the validity iene 
and s i jonificant beyon! 

ex, which was Sig the summary 


001 level. Table 2 presents 


Table 3 


Profile Combinations (see Fig- 3) Significant 
Beyond the 05 Level 


E 
A B C D 

1 
a RS e <001 
Ba 001 = <.00 
Ca ai <03 <9 
Da <.001 
Ea 


A and 
oA = A and mild BD, M +F; B = Poor S° F; 
ped S4 agl = Poor SA and severe BD, Mt 
Bp Good SA t dd severe BD, M; E = Good SA and $ 

F. 
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70 


60 


T Score 


r SA+Mild BD,M +F 
Good SA + Severe BD. M 
'———Poor SA +Severe BD.M+F| 
40 Good SA + Severe BD, F 


Fig. 4. Summary profiles of significant SA and BD 
combinations on the MMPI validity scales. 


eee fe SAT Mid BD. MTF 


table and Fig. 2 represents the significant in- 
teraction. As can be seen, male Ss with good 
SA have a similar configuration to female Ss 
with poor SA. 

Because of the discrepancy between males 
and females on SA, two-dimensional analyses 
were run between SA and BD for the two 
sexes in order to ascertain whether or not 
males and females could be combined for any 
BD, SA combination. The four pairs of pro- 
files compared for sex differences were good 
SA and mild BD, good SA and severe BD, 
poor SA and mild BD, poor SA and severe 
BD. This was possible to do since product- 
moment correlations between BD and SA for 
the males and females yielded an r of .14 
and .07, respectively, indicating that the two 
scales were measuring different variables. The 
only difference found between the two sexes 
was on good SA and severe BD, significant 
beyond the .001 level. Therefore the eight 
profiles could be reduced to five, three in 
which males and females had similar pro- 
files, and two in which the males and females 
had dissimilar configurations. The five profiles 
are diagramed in Fig. 3. 

Two-dimensional analyses were then made 
between all combinations of the five profiles 
in Fig. 3 to determine if any of them differed 
significantly from any other. Table 3 indi- 
cates the results of the 10 analyses. On the 
basis of these analyses, Profiles A, B, and D 
in Fig. 3 were combined, leaving: direct dis- 
tinct profiles as in Fig. 4. These were Profiles 
C, E, and a category in which A, B, and D 
belong. 


Discussion 


It can be suspected that the small 7 for 
several of the profiles in Fig. 3 contributed 
to their lack of statistical stability, 

The three significant profiles generally in- 
dicate that the F scale is in large Part a posi- 
tive function of behavioral disorganization, 
Thus a high F and low L may indicate overt 
expressions of pathological feelings as the 
relatively high F of delinquents in Rempel’s 
(1958) study Suggests, rather than dissem- 
bling or test-taking attitude as such. 

The poor SA and severe BD males and fe- 


mean. A clinical in 
the data would be 


vidual who is attempting 
and unconsciously 
capable of doing so 

In contrast wit 


thology 
lability, and dysphoria. 


à Leonard R. Gross 


sire to perform adequately, and overt a 
havior. Their attempt to present themse a 
as adequate, nondisturbed, and conforming 
social expectations is somewhat successful. or 
It would appear from inspection of the e 
SA groups that they tend to have a zelat 
high Z and K. Their reliance on denial of a 
hess, inadequate repressive mechanisms, in 
well as their rigidity, would indicate poor Ts 
terpersonal relations contributing to poor § 
cial behavior, ta- 
One of the most striking differences aa 
tistically is between the good SA and sev as 
BD males and females. The females; to 
pointed out before, are admitting ee 
pathology and acting out their heel 
tology. The males on the other hand see 
a picture of both conscious (L) and ae 
scious (K) denial and constriction of be dis- 
ior. Perhaps males that become acutely tra- 
turbed tend towards withdrawal and at 
tensive behavior, while females tend ow 
a More overtly emotional behavior eagle; 
It seems Worth emphasizing that atic 
Within a relatively homogeneous rane 
group the three “validity” scales ae 
S on crude a priori social-behavioral cri res: 
and can be considered personality ret 
Because this study is exploratory, it al 
aps raises more questions than it "MMPI 
While it is hoped that these three beete 
scales will be considered as representing 5 
portant variables and be used as an nae 
adjustment mechanisms and overt penei 
as well as “validity” scales per se, this st ns. 
has only hinted at two possible dimensi0 ë- 
The sample, as noted before, was not a 
quate to explore fully what differences, if hic h 
exist among the three profiles in Fig. 3, W les 
were grouped together. The BD and SA ers 
Were operationally defined and based on. wet 
ing clinical records. Hence, they were ee 
by that data which was common to all pë 
tients. 


Summary 


At the Roanoke VA Hospital, 50 male and 
50 female schizophrenic patients were pnt 
on a priori scales of behavioral disturban i 
(BD) and social adjustment (SA) from the! 
clinical records. They were divided into poo! 


a 


MMPI and Disturbance or Social Adjustment 


a good SA, mild and severe BD, and then 
It a on the L-F-K scales of the MMPI. 
Baret ound that Ss with severe BD had a 
little ee L-F-K profile, while Ss with 
Was ¢ had a “V-shaped profile. When BD 
on i ee with SA, three distinct profiles 
eh , indicating that the “validity” scales 
o measure personality characteristics. 
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GERALD WIENER 


Rosewood State Training Schoo 


This experiment 
fects of anxiety, 
culty of stimulus 


Projective devices, 

Experiments Concerning the effect of stress- 
ful situations and subjects’ 
learning and Performance h; 


also been found that Ss anxiety and stress 
instructions interact so that high test anxious 
(HA) S i 


er, and Craig- 
Child (1954), Briefly the 


Ss tend 
with achievement- 


1 tasks. To this extent, 
they impede performance, 

eact to test situations 
Propriate responses, LA 


ke inappropriate anxiety- 
reducing responses in a test situation, 


3a. When stress is introduced yia ego-in- 
volving instructions, expectations of failure 
1 This article is based upon a dis. i 


phy. The author would like to ack 
Sarason’s contribution 


l, Owings Mills, Maryland 


and punishment are aroused along ja 
achievement motivation. As a drive-pro e 
ing cue, stress instructions serve to bere 
Sponses which a given S has previously lear! =a 
to make to stressful test situations. HA Ss aa 
spond with anxiety, related to the achi 
ment motive in conflict with expected 1a 
and punishment, Thus, HA Ss in a sa 
situation tend to have greater anxiety 
strengthened anxiety-reducing responses. of 

3b. LA Ss have their prepotent a by 
responding to a test situation strengthene ‘a 
stress. For such Ss, stress does not serve É 
a cue for the introduction of anxiety ai 
anxiety-reducing responses, but to DE a 
achievement motivation and strengthen 
appropriate res onses. 

4. Increasing the difficulty of a probe 
Produces a conflict situation. Difficulty, nd 
here used, has been defined by Farber a 
Spence (1953) as a function of the a k 
of incompatible and competing response té on 
encies S must choose among in performing 
a given unit of a task. E 

4a. HA Ss react to difficult, conte a 
ducing test situations with anxiety-redu 
reactions, (5 

4b. Increasing task complexity for tA 
does not induce anxiety and anxiety-reduc 
responses. 5 

AE 4, 4a, and 4b lead to the Po 
diction that Ss’ anxiety, stress iste 
and task Complexity interact. HA Ss i 
pared to LA Ss should therefore show grea E 
impairment as test materials become P 
difficult, and this effect should be ine 
by stress instructions. This prediction ra 
tested on a motor learning task, a Rorschac i 
like perception problem, and a word associa 
tion test. 3 vs 

Siipola (1950) and Siipola, Kuns, and Tay 
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p 
E 


— 


5 


Anxiety, Stress Instructions, and Dificulty 


I x 

a mi p4 experimented with the effect of 
that for orschach reactions. It was found 
e ae which are colored compatibly with 
reaction requently seen percept elicit rapid 
colored f times compared to incompatibly 
Compatible a Where color and form are in- 
sponse t e, S is faced with competing re- 
times all leading to longer reaction 
ceived b e Rorschach situation is thus con- 

Continy y Siipola as containing a “difficulty 
em is um. A more difficult Rorschach prob- 
patible one which sets competing and incom- 
is pea tendencies into operation. It 
LA 5 icted that HA Ss in comparison to 
Breat : respond to Rorschach stimuli with a 
Com, r difference in reaction time between 
ey (less difficult) and incompatibly 
e oa difficult) colored blots. This effect will 

ages by stress instructions. 

oie. arly, data presented by Rapaport 
> Pp. 44, 55) indicate that stimulus 


Wo; g . 
eas associated with longer response times 
to elicit comparatively more response 

d with 


Wo e 
a than stimulus words associate 
su ively quick reaction times. These data 

Best that the word association test com- 


pes a difficulty continuum. More difficult 
Ps are those which elicit relatively many 
o erent responses and are associated pith 
hie reaction times, It is predicted that ee 
org npared to LA Ss will have 4 greaten if 
aay in reaction time between less difficu i 
ci „More difficult words on the word asso 
lation test, This effect will be increase by 


st i 
Tess instructions. 


Method 
tour groups of 10 Ss each were fee 
y these groups were extreme 5s, an 
ere extreme LA Ss as determined 
arason test anxiety scale. One £! 
S and one group of LA Ss were SIV 


Structj f , s. The 
ons o induce stress- s 
designed t n neutral in- 


Maining two groups were give A 

structions aie age presented with the 
ollowing tasks in the order listed: (@) 2 
Motor learning task, (0) a free eee: 
Word AA RRIS E Rorschach-like percep 


tual task. 


Tasks 


Motor learning experiment. 
Was constructed of eight woo 


A “bell maze” 
den blocks 
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mounted on a baseboard. Each of these 
wooden blocks had a different number of 
ordinary doorbell buzzers mounted on it. The 
number of buzzers on each block varied from 
two to nine. Each S was required to proceed 
from block to block and to learn the correct 
buzzer on each block. The correct buzzer was 
the one which rang when pressed. Thus, S 
was required to learn the correct path through 
a series of eight blocks. The problem con- 
tained three different correct paths, only one 
of which was activated at a given trial. After 
three practice trials, S was given 18 trials 
(six trials with each path) in which to learn 
the task. S was told which path he was to at- 
tempt before each trial. The number of errors 
made on each block on every trial was re- 
corded. 

Word association experiment. Twenty rela- 
tively «nonemotional” words were culled from 
Kent and Rosanoff’s (1927) and Rapaport’s 
word association lists. Ten of these words 
yere extremely highly associated with a single 
response word (E words). Ten were extremely 
low with respect to this variable (D words). 
These two groups of words were matched for 
frequency in written language according to 
the Thorndike word count (1921). Ss were 
required to state the first association which 
came to mind. Reaction time and the associa- 
tions elicited were recorded. Data concerning 
the word list appear in Wiener (1954, Ap- 
pendix B). 

Perception experiment. Thirteen ink blots 
were used. Seven blots were colored com- 
patibly with the most frequently elicited re- 
sponse (E blots). Six blots were colored in- 
compatibly with the most frequently elicited 
response (D blots). Eleven of the 13 blots 
used were details taken from the standard 
Rorschach blots. Of these, nine were used by 
Siipola (1950). The blots, their source, and 
data concerning associated respo: ; 
in Wiener (1954, Appendix B) nee PEDERS 


Instructions 


Ss given stress instructions we. - 
lieve that their intelligence, ae Ea a 
sonalities were being intensively studied tad 
that data obtained from this experiment would 
be compared with their school records. In th 
initially presented motor learning task s: 
were told that impossible-to-attain Scores a 
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the norm for students who have an average 
adjustment. These false norms were rein- 
stated during the course of the experiment (at 
the sixth and twelfth learning trials) in an 
attempt to increase stress as the experiment 
progressed. None of the stress Ss attained the 
suggested norms. 

Nonstress Ss were told that the task mate- 
rials were being pretested and that the re- 
sults in no way bore any relation to their 
abilities. Before the motor learning task was 
presented, nonstress Ss were correctly told 
that the problem was impossible to master 
and that they were not expected to do so, but 
that they should do their best. 


Subjects 


All 40 Ss were male students in an intro- 
ductory undergraduate course in psychology. 
They were given the Sarason test anxiety 
schedule about three months previously. None 
of the Ss verbalized any suspected connec- 
tion between the anxiety schedule and this 
experiment. HA Ss were in the top 10% of 
the distribution. LA Ss Were within the lower 
10%. A total of 432 Ss comprised the popu- 
lation of the test anxiety scores. Ss were sup- 
plied to the experimenter so that he did not 


know whether a given S belonged to the HA 
or LA category. 


Results 


Motor learning ex 
that anxiety level, 
culty interact: 


are more impaired o 


pects of the test (¢ = 2.08, 18 df, $ = .03). 
The interaction 


among anxiety level, stress 


#The statistical procedures used 
pothesis involving the motor learnin; 
lined and discussed by Wiener (195 
Analysis of variance or mean di 
were not used because of scaling 
with different levels of difficulty. 


in testing hy- 
g task are out- 
4, Appendix D). 
fference Statistics 
problems associated 


Gerald Wiener 


instructions, and difficulty level is significant 
only at the .12 level (¢ = 1.11, 36 df). 

Table 1 also indicates that LA stress Ss 
compared to LA nonstress Ss make fewer 
errors on the more difficult part of the task 
(t= 3.69, 18 df, p<.01). This finding 
considered alone would suggest that stress- 
ful situations are associated with heightened 
achievement motivation in LA Ss. However: 
data from Table 1 show also that HA stress 
Ss compared to HA nonstress Ss make fewer 
errors on the more difficult part of the prob- 
lem (¢= 3.23, 18 dj, p<.01, two-tailed 


test of significance). This unexpected finding ° 


may indicate that when all 18 learning trials 
are considered, the enhancing effect of in- 
creased motivation to do well obscures any 
impairing effect of the interfering responses. 

In summary, HA stress Ss compared to LA 
stress Ss are impaired more as difficulty in- 
creases. This suggests that interfering anxiety- 
reducing responses hinder performances as 4 
function of difficulty. LA stress Ss compared 
to LA nonstress Ss made fewer errors as diffi- 
culty increased. This implies that the effect of 
increased motivation, without corresponding 
interfering responses, is to perform better aS 
difficulty increases. However, HA stress SS 
compared to HA nonstress Ss were more effi- 
cient on difficult parts of the task. It is Bop 
sible that HA stress Ss experienced both im- 
pairing anxiety as well as heightened motiva- 
tion to do well, 

Perception experiment. It was predicted 
that instructions, Ss’ anxiety level, and diffi- 
culty level interact so that (a) HA stress 5S 
compared to LA stress Ss take longer in EES 
acting to D than to E blots, and (b) this 
effect is greater under stress than under non- 
stress instructions. Examination of the D-E 
difference in Table 2 shows that this inter- 


Table 1 


Mean Errors on Simple (Œ) and Difficult (D) Aspects 
of the Motor Learning Problem 


= — SS 
Stress Nonstress 
E D E D 7 
i HA E 63.9 161.8 a 59.2 180.5 
LA 49.5 122.2 52.8 156.1 


Anxiety, Stress Instructions, and Difficulty 32 


Table 2 


Mean Reaction Times in Seconds to 
E and D Ink Blots 


N 


Table 3 


Mean Difference (D— E) Scores of Percentage of 
Word Association Disturbance 


Stress Nonstress Stress Nonstress 
HA LA HA LA HA LA HA LA 
E blots i u S 3.88 D-E Disturbance A , 
4. 6.74 5.73 3.88 G m 
D blots = 795 6.57 535 Difference 22 5 22 As 
D-E Difference 3.80 51 B4 137 i 
Tae considered, HA stress Ss respond with more 


action obtains in fact (F = 5.03, 1 and 36 df, 
pe 02). 
HA stress Ss compared to LA stress Ss 
Hien longer reaction times to D than ot 
ots (t= 2.20, 18 df, p= 02). Also, 
Stress Ss compared to HA nonstress Ss have 
longer reaction times to D than E blots (= 
2.48, 18 dj, p = 01). 
Word association experim 3 
reaction times to D and E words did not 
Prove to be a useful response measure- ene 
of the comparisons among groups approaches 
Significance, although all Ss responded ai 
8teater latency to D than E words (f = 3-70; 
39 df, p < 01). S’s anxiety level and stress 
structions did not appear to affect differen- 
tial reaction times. In view of this, ve yen 
of the disturbance of the associated i 
Was utilized to reflect impair bance) 
sing Rapaport’s criteria and Jan's 
restatement oa them, each S was scat for 
e percentage of disturbance On P Epen 
Words. All types of disturbances Were ST 
together, The data are summarized in d with 
HA Ss compared to LA s$ rea with 
more disturbed reactions to D tompa 02 
words (F = 4.96, 1 and 36 df, fe have 
A stress Ss compared to LA stress ne 
More disturbed association 
2.89, 18 df, p= OL). This effect 
tain in nonstress situations 
teraction between anxiety, NST it 
the E-D variable is not significan stress SS 
LA stress Ss compared to LA Pon less pro- 
tend nonsignificantly to be impan® of where 
ceeding from E to D words 7 oe ns: G 
they respond with disturbed associat 
1.40, 18 df, p = .09). 
When the content of the r 
3 Wiener (1954, Appendix D) pr 
for utilizing analysis of variance si 
Jective tasks. 


ent. Differential 


esponse word is 


vides 4 rationale 
tatistics for pro- 


disturbed associations on D words, whereas 
LA stress Ss tend not to respond differentially 


to E and D words. 


Discussion 

nses to diagnostic projective tests may 
be in part a function of how individuals with 
different personality characteristics respond to 
variations of conflicting cues or difficulty lev- 
els within problem-solving situations. Test 
anxious Ss experience anxiety specifically in 
a test situation—a situation in which achieve- 
ment motives are elicited. This anxiety prob- 
ably arises in part as a response to a previ- 
ously learned conflict which is induced by the 
elicited achievement motivation. Therefore, it 
js assumed that in the test situation, stress 
instructions given to HA Ss evoke an incre- 
ment in the degree of anxiety these Ss experi- 
ence. HA Ss, then, react to achievement-re- 
lated conflicts with heightened anxiety, which 
leads to impairing anxiety-reducing responses. 

It is postulated that HA Ss are individuals 
who react to all test-related conflicts with im- 
pairing anxiety, whether the conflict is inter- 
nal or external to the HA individual. Since 
HA stress Ss react differently to E and D 
items, it is suggested that there is an inter- 
action between Ss’ internal conflicts and the 
external conflict situation: HA stress Ss ap- 
proach a conflict situation with anxiety and 
therefore cannot effectively resolve the prob- 
lems presented by a conflict situation. Thus, 
conflict situations engender anxiety in HA Ss 
so as to impair performances, and perform- 
ances in conflicting situations are also im- 
paired as a function of Ss’ anxiety level. 
Child’s interpretation seems very much simi- 
lar to this: “. . . in complex situations, where 
the subject is already in conflict between vari- 
ous response tendencies relevant to the task, 
the presence of irrelevant responses made to 
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anxiety heightens the conflict and interferes 
with performance . . .” (1954, p. 154). 

It is assumed that LA stress Ss compared 
to LA nonstress Ss have more achievement 
motivation and that both groups are rela- 
tively lacking in anxiety-produced interfering 
responses to test situations. Increased moti- 
vation, then, appears to be associated with 
less impairment as a function of response 
competition. Possibly, low motivation is as- 
sociated with a task attitude of not attending 
to the more difficult aspects of the problem, 
whereas heightened motivation causes Ss to 
attend to E and D items equally well. 

The results suggest that HA stress Ss and 
LA nonstress Ss tend to manifest similar overt 
behavior. The tendency for these two groups 
to behave similarly is associated with differ- 
ent dynamic antecedents. HA stress Ss are 
impeded by their anxiety from dealing effec- 
tively with the external problem situation. It 
appears that LA nonstress Ss, because of their 
relative lack of involvement, are not moti- 
vated to deal effectively with an external 
problem situation. 

It is possible that HA stress 
experienced increased motivation to do well 
along with impairing anxiety-reducing re- 
sponses. If this were so, the facilitating effect 
of increased motivation might partially ob- 


scure the impairing effect produced by inter- 
fering responses. 


Ss may have 


Summary 


This stud: 


y was designed to test the effects 
of anxiety, 


stress instructions, and difficulty 
level on a motor learning task and to general- 
ize the effects of these variables to a Ror- 


schach-like Perceptual task and a word asso- 
ciation task. 


Four groups of 10 S 
high anxious (HA) an 
(LA) group under st 
and LA groups unde 


S each were used: a 
d a low test anxious 
Tess instructions: HA 


r nonstressful instruc- 
tions. Each of these four groups was given a 


motor learning, word association, and per- 
ceptual task in the order listed. All experi- 
mental materials contained simple (E) and 
difficult (D) aspects. The D aspects con- 


tained a velatively greater amount of com- 
peting cues. 


HA stress Ss compared to LA Stress Ss 
were more impaired going from E and D 


Gerald Wiener 


items within the tasks. This finding was ob- 
tained for the motor learning, perception, and 
word association tasks. It is assumed that HA 
individuals under stress instructions experi- 
ence interfering anxiety-reducing responses 
and these interfering responses interact with 


conflicting environmental cues to cause im- 
paired performance. 


Stress instructions appear to affect LA SS 
so that LA stress Ss compared to LA non- 
Stress Ss tend not to be impaired going from 
E to D items. LA stress Ss compared to LA 
nonstress Ss make fewer errors on the D as- 
pect of the motor learning task and tend not 
to perform differently to E and D words of 


the word association task in responding with 
disturbed associations, 


This experiment’s results suggest that the 
response competition definition of difficulty 
can be applied to projective materials. Pro 


jective tasks, in part, may be viewed as prob- 
lem-solving situations, 
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DIRECT AND INDIRECT 
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n Mvestigators planning studies which include 
ables 1evement @s (One of the relevant vari- 
burpo can choose among several tests which 
Most rt to measure n Achievement. One of the 
ment commonly used measures of n Achieve- 
AT: x McClelland, Atkinson, and Lowell’s 
AT-fantasy method (1953). The Personal 
erence Schedule (PPS) recently published 
pe ards (1954) also yields a score for n 
obt ievement, a score which is mor easily 
ained in comparison to the fantasy method. 
ae the great dissimilarity of these two 
pu ods, both have been used for the same 
ie (predicting some behavior supposedly 
See ed to the strength of n Achievement). It 
ik ms necessary that some comparisons be 
de determine whether i tests do in 
easure the same thing in t i 
McClelland (1958) has ed an unpublished 
udy by Birney which reported a lack of any 
— 300) between 


relationship (r = — .002, N = 
PPS measures of n 


s to their util- 
chievement-oriente 
ehavior would also be 0 portance. 
it es absence of such information it seems 
is visable to make generalizatio 
ine achievement behavior when 
g compared were obtained DY 
Methods, 
t The purpose of the present study wa 
ermine what relationships exist among 
measures of achievement behavior. 
tests used were the TAT-fantasy 
the n Achievement scale S 
Sociometric measure. Previous stu 
typically investigated the relation: 


Achievement scores to specific task i 
ances in experimental settings- The socio 
metric measure which served as 


variable in the present study would seem to 
have the advantage of greater generality in 
terms of real-life behavior. 

Rotter’s Social Learning Theory (SLT) 
(1954, 1955) states that to maximize pre- 
diction from test responses it is necessary to 
differentiate among, and then evaluate sys- 
tematically, the internal characteristics of the 
individual (his goal preferences and expect- 
ancies). The psychological situation must be 
treated as a third determinant of goal-di- 
rected behavior. Several studies dealing with 
achievement motivation offer empirical sup- 
port for this conceptual scheme. French 
(1955), and in particular Atkinson (1953) 
and others (Atkinson & Raphelson, 1956; 
Atkinson & Reitman, 1956) have emphasized 
the need to take account of the achievement 
expectancies aroused by situational cues in 
order to maximize the prediction of overt 
achievement-oriented behavior from a meas- 
ure of the strength of internal motivation 

Neither the fantasy measure nor the PPS 
makes any systematic use of the concepts of 
expectancy, goal preference, or the psycho- 
Jogical situation. It seemed likely, therefore 
that the fantasy and PPS mesures of i 
Achievement would yield low correlations vith 
a criterion measure of overt achievement be 
havior. In addition, SLT would lead o : 
expect that the fantasy and PPS me ae 
would have a low correlation with each othe. 
This latter assumption is based on the b liei 
that the cues provided by a relativel; o 
structured fantasy situation endres SS 
ure) will lead the subjects (Ss) to dene 
expectancies for satisfactions that differ E 
kind from those developed in a highl aS 
tured “self-report” situation (di ae 
Should an individual’s ex a ENA 

pectancies in regard 
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to two psychological tests differ greatly, then 
the scores obtained on the tests are not likely 
to be highly congruent. 


Method 
Subjects 


Forty-four male undergraduate students 
comprising the entire membership of a social 
fraternity at Ohio State University partici- 
pated in the study. Each S was a member of 
the fraternity for at least six months and a 
student at the University for at least one 
year. The cooperation of the Ss was obtained 
by paying the fraternity for the approximately 
55 minutes necessary for testing, 


Procedure 


Each S$ wrote six four-minute imaginative 
(TAT-type) stories under neutral group con- 
ditions according to the standard procedure 
of McClelland et al. (1953). Cards 2, &, 1%, 
28, and 4 of the standard series were adminis- 
tered in that order. The fantasy n Achieve- 
ment scores were obtained by scoring the 
stories for Achievement Imagery and Achieve- 
ment Thema according to the definitions of 
McClelland et al. (1953). The possible range 
of scores was 0 to 12, A mean of 5.5 and a 
standard deviation of 2.51 were obtained for 
the fantasy test. A measure of the interrater 
reliability for the fantasy test was obtained 
by correlating (Pearson r) the scores ob- 
tained by the writer with those independ- 
ently obtained by another scorer. The result- 
ing correlation, based on the stories of 20 Ss, 
was .96. 

Following the completion of the stories, the 
Ss were given 55 Pairs of items from the PPS, 
28 of which comprised the n Achievement 
scale of the PPS. The remaining 27 items 
were used as buffers. The mean score for the 
n Achievement scale of the PPS was 12.4, 
with a standard deviation of 3.41. The pres- 
ent mean of 12.4 is significantly lower p< 
.001) than the mean reported by Edwards 
(15.6) for the males in his normative group 
of college students. This difference can be at- 
tributed to the highly selected nature of the 
present sample, which consisted entirely of 
fraternity members who were all enrolled in 
the College of Agriculture. The standard de- 
viation of 3.41 does not differ significantly 
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from the standard deviation of 4.13 reported 
by Edwards. x 
The Ss were then administered a sar 
metric measure of achievement behavior whieh 
was adapted from Fitzgerald’s (1958) ico 
ure of overt dependency. This instrument, 
which is based on a nominating tee 
served as the criterion measure and Ange 
a quantified index of overt achievement the 
havior. Two descriptions were devised for of 
Present study to describe the extremes je 
achicvement behavior, The statements ai 
scribing behaviors considered most rep" ° 
sentative of overt achievement-striving were: 


Description A 
Studies long and hard before exams 
Regardless of the activity strives to be best god 
Likes to demonstrate his abilities and make a 
impression p he 
Sets very high standards for himself which 
strives to attain 


d 


sir . id- 
The statements describing behaviors — 
ered least representative of overt achieveme’ 
striving were: 


Description B 
Finds reasons not to study before exams i 
Doesn’t seem concerned whether he comes ou 
or last in competitive activities 


iag kill 
Seldom gets involved in tasks requiring great $ 
or effort 


Seldom strives to improve his performance 


Each S was provided a copy of the ee 
tions which were labeled Description A oe 
Description B, along with a list of the age 
of all the fraternity members. Ss were sae 
asked to select from the list of members Fts 
name of the man who, in general, best ae 
Description A.” The Ss then selected the naa 
of the man who “best fits Description i 
Following this selection, the Ss chose the te 
who “next best fits Description A,” and then 
the man who “next best fits Description B. 

The nominations were thus made alternately, 
and in this manner each § made three nomi 
nations for each description. The nomination 
each S received on Description A were score? 
+3 for “best fits,’ +2 for “next best fits, 

and +1 for “third best fits.” Similarly, the 
nominations for Description B were score 

—3, —2, and —1. An S’s total score was the 
algebraic sum of all the nominations he re- 
ceived. A constant was added to each S’s to- 
tal score to convert all the scores to positive 


first 


O_O 


-> i 
or 


Achievement 


A Table 1 
nte olati 
tercorrelations Among the Measures of 
Need Achievement and Overt 
Achievement Behavior 


Motive and Overt Behavior 


(V = 44) 
PPS Sociometric 
TAT £ . 
x —.05 33 
PPS ‘09 
*) <.05 level, 


Va 

ony The sociometric ratings yielded a cor 

Tht hal reliability of .94. As M the 

only it study, the method of nominating 

Normal e extremes of the group provided a 
distribution of scores. 


Results 


ce te sis of the relationship 
and mn and PPS measures of n 
Correlati, t achievement behavior was 
A ing (Pearson r) the sociome 


ings wi 
ite the scores on the fantasy Ai ere is 
: that there 


between the 
Achievement 
made by 
tric rat- 


no ‘ 
the sit tionship between the 
a of n Achievement 
ere index of overt achievemen 
be oy a significant relationship ( 
the Š 5) between the fantasy measure 
h ciometric ratings. 
fantas amount of relationshi 
as rid and PPS measures of 
re ee by correlating 
indicates the fantasy and P. 7 
ing) tees that the data obtained from Te 
aa ruments are dissimilar and that the fa 
ies and PPS tests are not equ! 
of n Achievement. 


p between the 
n ‘Achievement 
(Pearson r) the 
S tests. Table 1 


valen 


Discussion R 
of relation- 


According to SLT, the degree 
oD between a measure of need strength Te 
aa behavior is typically of an unimpres 
Sider A because of the failure to take 

ration the view that any giv 
ny within it possibilities for the satis® 

Many different needs. Which parti i 
need an individual will seek to satisfy 
depend on the value of that satisfaction or 
im, and his expectancy as to whether his be- 
havior will lead to that satisfaction 


in a pat- 
ticular situation. The absence of any relation- 
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ship between the PPS measure of n Achieve- 
ment and the sociometric ratings is therefore 
not unexpected in view of Edwards’ failure to 
systematically distinguish between what an 
individual says he would like to do and what 
he says he has done in the past. It appears 
that the PPS is a confounded measure of n 
Achievement because of the failure to con- 
sistently word items in the same manner and 
differentiate between statements of expectancy 
and statements of goal preference. It can be 
concluded that the PPS is not a valid pre- 
dictor of overt achievement behavior in a col- 
lege population when peer ratings are used as 
the criterion measure. 

The TAT-fantasy measure is significantly 
related to the sociometric ratings and appears 
to be a more valid predictor of overt achieve- 
ment behavior than the PPS. It should be 
noted that reliabilities between .54 and .78 
have been reported for a six-picture TAT 
measure of n ‘Achievement (Haber & Alpert, 
1958). This suggests that a more substantial, 
put still only moderate, relationship between 
the fantasy measure and overt behavior might 
have been obtained with a more reliable form 
of the fantasy test. For purposes of predic- 
tion, however, the obtained fallible scores 
yield a correlation of .33, which would result 
in only a 5.6% reduction in errors of predic- 
The results of this and earlier studies 


tion. 
(Atkinson, 1953; Atkinson & Raphelson, 1956; 
Atkinson & Reitman, 1956; French, 1955) 


clearly indicate the necessity of considering 
overt achievement-striving a complex, multi- 
ply determined behavior and suggest, further, 
that the failure to do so is likely to result, at 
best, in only low to moderate correlations þes 
tween a measure of motive strength and some 
behavioral criterion. It is important to em- 
phasize that the fantasy scores of n Achieve- 
ment in the present study were based on a 
theme count. When “clinically” interpreted 
the fantasy method might be a more valid 
predictor of achievement or other kinds of 
behavior. 

The absence of any relationship between 
the fantasy and PPS measures indicates that 
these tests are not equivalent measures of n 
Achievement and that inferences from one 
test cannot be generalized to the other when 
n Achievement is the relevant variable. Thus 
the present data support the earlier finding 
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of Birney, and that of de Charms et al. 
(1955), who also found that Ss perform in 
dissimilar manners on two tests which sup- 
posedly measure the same thing (n Achieve- 
ment) when one test is an indirect measure 
of the motive and the other a direct measure. 
A possible explanation for these findings, on 
the basis of SLT, is that the difference in test 
performance may be mediated via the differ- 
ent satisfactions that the Ss expect to obtain 
in the two situations. The fantasy situation 
may provide cues that lead to expectancies 
for satisfactions related to being creative and 
imaginative. In contrast, the self-report situa- 
tion may lead to the development of expect- 
ancies for satisfactions related to being self- 
revealing or introspective. 


Summary 


The purpose of the present study was to de- 
termine the degree of relationship between 
two measures of n Achievement (the TAT- 
fantasy method and the n Achievement scale 
of the PPS) and a criterion measure of overt 
achievement behavior; and to determine the 
degree to which the two n Achievement meas- 
ures yield equivalent scores. On the basis of 
Rotter’s Social Learning Theory, it seemed 
likely that the two measures of n Achievement 
would yield low correlations with a socio- 
metric index of overt achievement behavior. 
It seemed, further, that the two measures of 
n Achievement would have a low correlation 
with each other. 

Forty-four male undergraduate subjects 
who were members of the same social fra- 
ternity were administered the TAT-fantasy 
and PPS tests of n Achievement, followed 
by the sociometric measure which was based 
on a nominating technique. The relationships 
among these instruments were analyzed by 
computing the product-moment correlations 
between the three measures. 

The obtained correlations indicate that 
there is no relationship between the PPS and 
the sociometric measure, and no relationship 
between the PPS and the TAT-fantasy test. 
A significant correlation (r= 33) was ob- 
tained between the TAT-fantasy test of n 
Achievement and the sociometrie measure. 
It was concluded that for a college popula- 
tion the fantasy test appears to be more suit- 
able than the PPS for the prediction of overt 
achievement behavior. 


David Marlowe 


The results were interpreted on the basis of 
Rotter’s contention that additional variables 
are necessary if greater predictive utility 1S 
to be obtained with tests that measure a 
strength of internal motivation. The lack © 
relationship between the TAT-fantasy test 
and the PPS was interpreted as being due ta 
the different kinds of expectancies which the 
Ss develop in the fantasy and PPS situations 
The correspondence between the theoretica! 
interpretation of the present data and previ 
ous research findings was noted. 
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AN APPRAISAL OF TAULBEE AND SISSON’S 


“CONFIGURATIONAL 


PROFILES OF PSYC 


ANALYSIS OF MMPI 
HIATRIC GROUPS” 


SOL L. GARFIELD AND JON SINEPS 


University 


| gm article in this journal, Taulbee 
Objectiy on (1957) presented a technique of 
e apo figurationa analysis applied to 
TOtic PI profiles of schizophrenic and neu- 
ized parats Sixteen scale pairs were uti- 
ctiteria ich differentiated significantly two 
‘chiatric and three validation groups of PSY” 
“The fi patients. According to the authors, 
iaoe of this study indicate that the 
nique T of a configurational analysis tech- 
effectiy, or analyzing MMPI data yields an 
etirotie means for differentiating groups o 
Mec schizophrenic patients” (Tau 
ee ee 416). 
Sented eir study, Taulbee an 
eir sere cutoff scores for diie? a 
Cordi izophrenic and neurotic patients. f 
| ng to their scheme, a scale part score 0 
While more is a likely indicator of sei 
tive of score of 6 or less is considered in i 
Wo schizophrenia. Any score petween thes? 
or aues is considered as «indeterminate, 
of Ondiagnostic for these specific categorie 
Ra atients. They also mentione t kee 
Bro o a normal sample and other psychia s 
tee limits the application © these m 
whi (1957, p. 417). However» felt tha 
ere there is a problem of differentiatins 
eee neurotic and schizophrenic on 
Ons, “the cautious application of these 5¢å le 


es may be quite useful” (1957, P: an 
me mention was made also that subsequen 
chizophrenics: 


—_- o aa 


q Sisson pre- 
differentiating 


of Nebraska College of Medicine * 


The Present Study 


in the clinical situation, most re- 
eral personality and diag- 
her than to differentiate 
between two specific categories such as neu- 
rosis and schizophrenia, the pragmatic test 
of the diagnostic value of any technique is to 
see how successive referrals are classified or 
diagnosed. In most instances the diagnostic 
possibilities for a given patient include other 
Jabels than just schizophrenia or neurosis. An 
effective technique for general clinical practice 
entiate not only between two se- 


must differ 
lected groups of patients, but should be able 
to differentiate these groups from other diag- 


nostic groups- Frequently a diagnostic tech- 
nique which differentiates one pathological 
group from a control group fails when it is 
applied to the range of psychopathology en- 
countered in the clinic or hospital. Conse- 
quently, we were interested in seeing how this 
particular approach works with a regular run 
of diagnostic referrals. 

From our files, 129 case records were se- 
lected. These cases represented all cases of a 
nonorganic nature given the MMPI as part 
of their diagnostic test battery over the past 
two years and for whom there was a specific 
final diagnosis from the psychiatric staff. This 
group of patients was a heterogeneous grou 
with diverse diagnoses. Sixteen were dinana 
as schizophrenic, 35 as neurotic, and the 
others were distributed among aik 
disorders, antisocial reaction, other ERA 


Since, 
ferrals are for a gen 
nostic appraisal rat 


ae indicated that latent S oe went de 

Score ee ge ama E 4 tn condihons ey The mean age for the total 

7 ore the “indeterminate” rang group was 32.7 years (SD 13.4), with the 

io means for the various subgroups being close 

1 Nebraska Psychiatric Institute. to this figure. For example, the mean age for 
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Tabl 
MMPI Classifi 


cation of Cases Diagnosed as Schizophrenia and Psychoncurosis 


Sol L. Garfield and Jon Sineps 


el 


MMPI Classification 
Patient inate 
Diagnoses Sex N Correct Incorrect Indetermin: 
2 
Schizophrenia M 9 6 1 3 
F 7 4 0 
Psychoneurosis M 12 1 5 a 
P 23 6 4 
Total 51 17 10 24 
i i : 5 ; alyzed 
the schizophrenic group was 31.1 (SD 12.8), Psychoneurosis or schizophrenia were analyze 


while the mean for the neurotic group was 


32.1 years (SD 9.9). The mean educational 
level of the total 


school (SD 2.3), 
same for all subgroups. The group consisted 
of 74 males and Since Taulbee 


subjects, sepa- 
rate analyses were made for each sex, 


whom there was a final diagnosis of either 


? Comparisons of the mean age 


and education for each sex in the Various groups and 
did not reveal any unusual differences, 


Were also made 


MMPI Classification of Cases with Diagn 


n 
separately. These findings are presented e 
Table 1. The data on the other cases Y in 
also analyzed, and the results are given 
Table 2, iori 
As can be seen from Table 1, a majony 
of the patients diagnosed as sehizopbren t y 
correctly classified by the MMPI scales. hile 
one case out of the 16 is misclassified, How- 
five are categorized as “indeterminate. ob- 
ever, a different pattern of results e 
tained for those patients diagnosed as a 
choneurotic. In fact, in the latter group clas- 
seven patients out of 35 were renee: or in 
sified, the remainder being misclassifie ft 
the indeterminate Category. In terms Sh 
data presented in Table 1, 33% of these 


oses Other Than Psychoneurosis and Schizophrenia 


MMPI Classification 


Indeter- 
inate 
Patient Diagnoses Sex N Schiz. PN ma 
4 
Antisocial reaction M 19 14 1 1 
Sociopath F 2 1 0 
Personality disorder 5 
Passive-Aggressive; Emot. unstable M 17 10 2 7 
F 13 4 2 3 
Other psychotic conditions M 5 0 2 1 
F 5 3 1 0 
Psychophysiological reactions M 2 1 1 1 
F 3 1 1 
Other 5 
Adjust. Diffic.; Alcoholism M 10 5 0 F 
F 2 1 0 1 
Total 78 39 10 28 


| 
| 


v. 


Appraisal oj Taulbee and Sisson’s Analysis of MMPI 


woul 
ae i a diagnosed, almost 20% 
mainder waiter, classified, and the re- 
gory. On the te l in the indeterminate cate- 
Stoups alone ane of these two diagnostic 
Would appear l i ape analysis used here 
aid in peyehi o : ave some limitations as an 
current alle wie diagnosis. Certainly, the 
Ose tonted pre much less favorable than 
S menti y Taulbee and Sisson. 
are referre ion earlier, however, when cases 
lagnostic for Psychological evaluation, the 
Schizophr question is not usually limited to 
any Rant psychoneurosis. Frequently, 
Practica] sibilities are entertained, and a more 
is confi clinical test of the effectiveness of 
Works “aco approach is to see how it 
he a other clinical groups. 
tients e secured with other types of pa- 
always Bing the diagnostic picture is not 
Most iit ear are presented in Table 2. The 
One-half cP ye finding is that slightly over 
hed as of these 78 patients would be classi- 
isson schizophrenic in terms of the Taulbee- 
ticular] configurational method. This 1s par- 
Social = true of patients diagnosed as anti- 
ing is r sociopathic. A somewhat similar find- 
toad hoted with those patients falling in the 
up Pe a of personality disorders made 
Sock nanii of individuals with passive" 
In fa Sive patterns and emotional instability. 
a Sh an analysis of Table 2 indicates that 
dieni ee diagnosis is much more ire 
here ons the patient groups represents” 
neur lan is any other. Certainly the psy¢ or 
re otic pattern seems to be much more $ 
quent, In our total group of patients, 0P Y 
wha ceived a clear-cut psychoneurotic score, 
reas 59 were classified as schizophren'* 
in basis of these data, one might pi 
P Securing “schizophrenic” scores qui : 
ently with a broad variety of patient grouPs- 


Discussion 


ars the basis of the data ¢ 
y, it appears that the pro 
gues and Sisson may be i 
n differentiating between schizophrenic 


ollected in this 
file method of 
less valuable 
s an 
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neurotics than previously reported. It also 
does not appear to offer much promise as a 
diagnostic measure when applied to the wide ` 
range of cases seen in clinical practice. With 
the exception of the small group of schizo- 
phrenics in this study, the psychoneurotic 
and other patient groups provide many false 
ves as well as a large number of inde- 
terminate diagnoses. The false positives seem 
occur with the scales designated as 


largely to 

indicating a schizophrenic diagnosis. It would 
thus appear that many more incorrect and in- 
determinate diagnoses would be secured than 


would accurate ones. 

Obviously, the same problems of compa- 
rability of sample populations and the reli- 
ability of psychiatric diagnosis apply to the 
current researches as to other studies which 
are based on groups differentiated in terms of 
such diagnostic criteria (Garfield, 1949). If 
such difficulties contribute to the problems of 
replicating the work of other investigators, as 
seems reasonable, it is apparent that the test 
patterns secured in one setting can only be 
plied with extreme caution to other settings. 


positi 


ap) 
Summary 


The configurational analysis of MMPI pro- 
files devised by Taulbee and Sisson was ap- 
plied to a group of 129 patients in different 
diagnostic categories. In terms of the data 
obtained, it appears that this method offers 
little promise as a diagnostic measure when 
applied to unselected samples of patients in 
clinical practice. The perennial problems of 
the comparability of patient samples and the 
reliability of psychiatric diagnoses also are 


pertinent here. 
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THE EFFECTS OF WARM AND COLD INTERACTION 
ON THE ADMINISTRATION AND SCORING OF 
AN INTELLIGENCE TEST? 


JOSEPH MASLING 


Syracuse Universit y 


Many recent studies have examined the in- 
fluence of the psychologist-subject relationship 
in projective testing. Despite the methodo- 
logical errors (Hammond, 1954; Levy, 1956) 
which have characterized some of this re- 
search, there is evidence that subjects do not 
give the same responses to one examiner that 
they give to another, because of the instruc- 
tions (Henry & Rotter, 1956), the reinforce- 
ment given the responses (Wickes, 1956), the 
situation (Klatskin, 1952), and the person- 
ality of the examiner (Lord, 1950; Sanders & 
Cleveland, 1953). Not only does the examiner 
influence the subject's test behavior, but it 
has been demonstrated (Masling, 1956) that 
a subject by acting “warm” or “cold” can 
influence an examiner’s interpretation of re- 
Sponses to a projective test, 

The ambiguity which faces both the ex- 
aminer and the subject in a projective testing 
situation makes it Probable that each will be 
influenced by the other in attempting to com- 
plete their respective tasks. In intelligence 
testing, however, the instructions are 
the stimuli are clearly defined, and t 
right and wrong 
administers an intelli 


1 The author is greatly indebted to 
H. O. Beldin, Dan Briggs, Robert 
Henderson, Randall Martin, 
Patulo, Eugene Quarrick, Donald Smith. 
Studebaker who so willingly 
Neila Dunay and Eileen Shap 
petently as accomplices; and 
ford Dean, Howard Friedman, Sidney Orgel, Bertram 
Rothschild, Jerome Schiller, Edward Siegel, and Her- 
bert Tothill who served as judges in various Parts of 
the study, 


» and Gerald 


The examiner-subject relationship in ie 
sence testing has not received a great a ing 
attention. During the course of barrier 
Most examiners are exhorted to establish ’ The 
Port” and admonished to be “objective. rer 
“objective” examiner is charged with the ate 
Sponsibility of deriving as valid an estim 
of the intelligence of the subject as “i ati 
obtained, without regard for his persona ae 
tudes about the subject. He is thus ae e 
to be standardized and depersonalized vesti- 
purpose of the present study was to F 
gate the extent to which an examiner ie 
divest himself of personal bias in admin} this 
ing and scoring an intelligence gem e 
Case, three verbal subtests of the Fe 
Bellevue II (hereafter called the W-B highly 
When the subject acted in either a or in 
approving, interested (warm) ted (ed) 
a persistently rejecting, disinterested h were 
manner. The specific hypotheses whic 
tested were as follows: ; 

I. When an examiner tests two ee 
one of whom acts warm to him and the 0 the 
cold, he will be more generous in scoring 
responses of the warm subject. hep saa 

II. During the course of administratio. 3 
an intelligence test to two subjects, ee 
whom is warm and the other cold, an ies 
aminer will: (a) make more reinforcing a ) 
ments to the warm subject than the cold; iv- 
ask more questions of the warm subject, P 
ing him the opportunity of clarifying of 
formulating an answer. 


of 


Method 


; ; ete 
The interaction. Manipulation of the ante 

action was effected through the use of ae 

tive female accomplices, Posing as test su 
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Effects of Interaction on Intelligence Test 


Jects 
the aa who acted either warm or cold to 
complice ne the warm condition, the ac- 
m the test: ed interested in the examiner and 
tions and ; she responded freely to his ques- 
iking for — to communicate respect an 
Complice Ee = In the cold condition, the ac- 
€ test ad | disinterested and bored with 
hat of ees examiner; her attitude was 
Signment y alng an unpleasant class as- 
soon as which she wanted to complete as 
test inte Possible, She tended to answèf pre- 
t toughoni oo questions in monosyllables an 
aminer, In L eye contact with the ex- 
accomplice j e middle of each cold session the 
ut on sun ia a deliberate, calculated fashion 
chological Es thereby increasing the PSY" 
examine istance between herself and the 
rA 
ate Tat The examiners Wer 
€ area a at Syracuse University; 
Special ed clinical psychology, three each in 
One in th ucation and remedial reading, an 
ach ey e area of developmental psychology- 
Course be fa had completed at Teast one 
of intelli e administration of individual tests 
tently erat and, in addition, 
m oo in or had comp! s 
Mated ‘eee in projective testing- The esti- 
Ous to ia of W-Bs each had given previ- 
+ eee ranged from 18 to over 200, 
median of 21. 
ked to partici- 


W. 
Pate en each examiner was aS 
n the study he was told that the author 


Was j z 
interested in the comparability of various 


s 
ort forms of the W-B. He was informed 
or three 


that 
he would administer either tW9 
icular sub- 


e 11 gradu- 
four in 


subt. 
eee and that the choice of particu 
or each examiner would be m6 e on a 
two under 


Tan 
iste basis. The Ss would be tw a 
ment la who were completing their assign- 
ments; participating in psychological experi- 
No part of the requirement of the intro- 
T in psychology. examiners 
Other asked not to communicate ¥ 
they regarding any phase of the study, a" 
cuss en requested to urge the Ss not to dis- 
Te 8 study with their friends- è: 
REN ing session. Each examiner adminis- 
hensi th subtests—Information, Compre- 
wh ion, and Similarities—to both ss, one of 
E om acted warm to him and the other cold. 
ach accomplice had five cold and five warm 
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roles, with the order of presentation of con- 
ditions and accomplice counterbalanced. 

Scoring. To insure uniformity of scoring 
procedures the examiners were requested to 
use as a guide to scoring only the instructions 
found in Wechsler's (1944) “Measurement of 
Adult Intelligence,” third edition. They were 
asked not to use any supplementary manuals 
or monographs. 

Test responses. The experimenter prepared 
a script for each accomplice to memorize and 
repeat to each examiner, regardless of the in- 
teraction condition she was to establish with 
him. For each accomplice, 14 of these re- 
sponses were written to maximize difficulty in 
scoring. As examples of the answers that were 
used, ‘Accomplice A’s script called for her to 


make these responses: 


Information subtest: 

Item, population: «180 million” 

Item, Faust: uyt is an opera. I've listened to it 
heard it. I'm not sure of the composer’s name. It is 
French, or maybe German, something like G-o-n-o-t 
Gonot. I really don’t know.” (She pronounced the 
name Gó-no.) 

Item, Habeas Corpus: 
Corpus? That gets you ou 


sometimes.” 
Similarities subtest: 
Item, praise and punishment: “They are alike in 


that they are both ways of criticizing other 
itot ai eo] 
in order to improve their behavior.” people 


Accomplice B’s script contained these re- 


sponses : 


Information subtest: 
Item, population: “420 million” 
Item, Koran: “That is the bible of the Arab peo 


ples.” 
Comprehension subtest: 
Item, laws: “Laws establish a set of rules 
everyone knows what is expected of him.” so. ibat 
Item, land: “Because it is more desirable.” 


Each accomplice was warned : 
of adhering rigorously to tie eee pees 
her without making any substitutions ae 

provisations. If asked for additional inf ae 
tion they were told to repeat the subst orma- 
the original answer, unless the script ance of 
for a clarification of the response agente: 
of the typescripts showed that a analysis 
plices did, in fact, repeat the assi ateo 
swers for each of the examiners E an- 
few minor deviations from the script ut a 
The testing room was equipped with a tape 


“Like a writ of Habeas 
t of jail, when you're in, 
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recorder and each examiner was asked to re- 
cord both sessions. Examiner 9, however, had 
the input volume turned so low that it was 
impossible to obtain a typescript from either 
of his tapes, and Examiner 10 was unable to 
work the recorder for his first session, For this 
reason Hypotheses Ila and IIb were tested 
using the typescripts of the remaining eight 
examiners. Since all examiners turned in 
scored test forms, Hypothesis I was tested 
with an WV of 10. 


Results 


There was no mistaking the impact of the 
warm and cold conditions on the examiners, 


All reported that one S$ seemed particularly 
disinterested in the test, with some emphasiz- 
ing the notion that this represented “sick” þe- 
havior. One examiner correctly guessed that 
the Ss were really accomplices, and he was 
therefore replaced and his data were not used. 
Krasner (1958) has reported that in studies 
attempting to establish conditioning of ver- 
bal behavior without awareness approximately 
5% of the Ss learn what the experimenter is 
trying to do. It is generally accepted practice 
not to use the data on these Ss. 
Hypothesis I was tested by comparing the 
way in which each examiner scored the re- 
sponses given him under the two conditions. 
Since the experimenter had intentionally writ- 
ten responses that gave a higher “true” T 
for one of the accomplices than for the other, 


Joseph M. Masling 


. a a ined 
the bias of examiner scoring was pin 
from the mean of the 10 scores give! 


š cores. * 
accomplice, rather than from the raw s 


Once a mean score for each accomplice Si 
been obtained, the extent and eer. 
differences from each mean were derive o 
each examiner. To test for the probability as 
obtaining a distribution of differences su ste! 
this by chance, the Walsh test, as ne 
by Siegel (1956), was used, yielding a 
tailed p value of .056, jn- 

Hypothesis I can also be evaluated Py hio 
spection of Table 1. Of the five eari a i- 
tested Accomplice A under the warm a the 
tion, four gave her scores greater uan a 
mean, while of the five examiners who cores 
her in the cold condition, four gave her sults 
smaller than the mean. The identical i the 
were obtained for Accomplice B: four 0 ma 
five examiners who interacted with neni the 
warm manner gave her scores greater tha. a 
mean, while four of the five examiners ave 
interacted with her in the cold condition 8 
her scores smaller than the mean. cripts 

In order to test Hypotheses II, types view: 
were made from the tapes of each gene e 
The eight pairs of tapes that were “tifia 
were transcribed and coded, with iden e 0 
tion of the name of examiner, S, and EYP yen 
interaction removed. Two judges were Eio 
typescripts that began with the first Eea ost- 
on the Information subtest, the pre- an 4 thes 
test interviews having been removed, an 


Table 1 


Raw Scores (and Deviations from the Mean 


) Given Each Accomplice by Examiner 


and Interaction Condition 


W-B Accomplice Aa Accomplice B® 
Previously Cold 
Examiner Given Warm Cold Warm 
—0.5) 
A (200+) 47 (42.7) 48 (-0 
3 (0) 43 (—1.3) 47 (—1.5) 3.5) 
: (So) 45 (40.7) 45 (- 
: o) 47 (+2.7) 49 (+0.5) —1.5) 
5 (11) 41 (—3.3) 47 ( 0.5) 
20) 46 (41.7) 49 (+0- 
oo 43 (-13) 49 (40.5) 
43 (-1.3 52 (+3.5) 
2 (100-+) 45 (40.7) otk 4g (—0-5) 
a ap) 43 (—1.3) 51 (4-2.5) 
E Ae eae ee eee ee 
E Mean senre a 4a! 
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Table 2 


Examiner Remarks by In 


teraction Condition and Accomplice 


Accomplice A 


Accomplice B 


Se 


W-B Warm Cold Warm Cold 
Erami Previously a = 
XAminer Given R" Q R" Qe Re Qe R" Q» 
i . _ — 
(200+) 4 5 0 5 
: (40) r 6 9 G 9 e 
4 oop 24 10 23 s8 
š a9 24 10 16 6 
6 7 3 12 2 5 
7 ee ği 9 3 37S 
8 (20) 12 2 17 5 
=_ 
* Reinforci 
A 
f four verbal behavior during the cold interaction by 


A examiner remark t j ar 
: D 
statement. reintoreine a oe Snel 
laneou ’ questioning stater g 2 : anal 
Astar s. A reinforcing statement WaS sort 
or ny remark designed to encourage, SUPI li 
„assure the S or the response he made 
t OK,” “swell,” “I knew you could answer 
hat,” etc.). A punishing statement was de- 
aned as any remark designed to insult or dis- 
Parage the S or the response he made (“I 
hought everyone knew that answer,” etc.). 
to question was defined as any, 
t ave the S give additional 
o clarify an answer (“Tell me mor 
ne “Can you be more specific,” ete 
E category was use 
Xaminer remarks, including such phra 


t 
Uh-huh” and “Mm-hmm.” +. Hi 
remarks 1M the 


t here were 285 examiner p he 
resting sections of the 16 interview of 
Judges independently agreed O the ra he 


remaining remarks taking P ace ©? 
ence, The distribution of reinforcing and ques- 
tioning remarks by examiner, accomplice, dacs 
condition is found in Table 2. Si ane 
agreed that only two punishing me his 
made, no further work was done with t z 
category nor was there any analysis ©! 
Wastebasket miscellaneous category- 

Once the number of reinforcing and ques- 
tioning statements had been obtained, 
Parison was made of each examiner's verbal 
behavior during the warm interaction with his 


use of the Wilcoxon matched-pairs signed- 
ranks test (Siegel, 1956). Using one-tailed 
probability values for all tests of significance, 
it was found that examiners made more rein- 
forcing statements to the warm Ss (p value 
between .01 and .025), and they asked more 
questions of the warm Ss (p = .025). The 
sum of reinforcing and questioning statements 
was also greater for the warm condition than 
the cold (p between .01 and .025). 

While the experimental hypotheses were 
substantiated, the differences between condi- 
tions seemed much smaller than the differ- 
ences among examiners. For example, Ex- 
aminer 1 made a total of only 14 remarks to 
his Ss, while Examiner 7 made 64. Examiner 
g’s scoring favored the warm condition by 4.8 
points, while Examiner 5’s scoring was biased 
in favor of the cold condition by 1.8 points. 
Since it was possible that the more experi- 
enced examiners were least biased by the in- 
teraction, rank-order correlations were com- 
puted between the number of W-Bs previ- 
ously given and the dependent variables. None 
of the rho’s were significantly greater than 


zero. 
Discussion 


The results of this study indicate that the 
examiner-subject interaction influenced the 
psychologist’s behavior in the administration 
and scoring of the three subtests of the W-B 
JI. When the instructions to the cold accom- 
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plice are considered, i.e., to answer in mono- 
syllables, to appear disinterested, and the 
typescripts of the sessions studied, it becomes 
clear that the examiners tried to make con- 
tact with the cold S and, in failing to do this, 
became silent. While the examiners were un- 
doubtedly trained to encourage the S, this 
was difficult to do when friendly overtures 
elicited disinterest and rejection. The feelings 
which the interaction aroused in these examin- 
ers obviously influenced the manner in which 
they administered the tests. With warm, re- 
sponsive Ss they tended to encourage and 
question; with cold Ss they tended to remain 
silent. 

It is difficult to predict the extent to which 
this particular finding can be generalized to 
nonlaboratory situations, Probably few indi- 
viduals taking intelligence tests act as hostile 
and nonparticipating as the cold accomplice, 
However, some Ss, notably children, may be- 
come threatened by the testing situation, re- 
sponding with belligerence or silence or other 
variations of avoidance. Schafer (1954) has 
described the dynamics of adult Ss 
not interact favorably with the examiner, 
Thus, the cold accomplice represents a cari- 
cature of certain kinds of 5 behavior, perhaps 
overdone, but posing problems which examin- 
ers face in milder forms with bona fide Ss. 

What effect does the style of administra- 
tion have on the score earned by the $? Since 
the accomplices repeated the scripts prepared 
for them, no direct evidence is available from 
the present study. One 
Durea, 1948) found, 
given the Stanford-Bir 
discouragement ie 
earned a mean T 


who may 


on or who antici- 
n intelligence test 
might under other 


Since Poorly ad- 


justed, easily threatened Ss may unwittingly 


Joseph M. Masling 


discourage the examiner from relating to them 
favorably, their performance would suffer, not 
because of lack of potential but because of 
the interaction. This, along with their greater 
anxiety and distractibility, could account for 
the depressed IQ scores ordinarily found in 
poorly adjusted children. ae 

The interaction also affected the examiners 
“objective” judgment of the scoring of rela- 
tively “objective” material. Even though they 
had the Wechsler manual available, a Te- 
sponse given in the warm condition tended to 
be given greater credit than the identical rej 
sponse given in the cold condition. This bi 
is even more striking when it is considere 
that the scoring occurred some time after the 
testing, allowing the examiners some perspec- 
tive regarding the events of the session. Again, 
this study exaggerated the situation found 
most clinic settings, since the examiners We" 
given responses that were selected becausé 
they were difficult to evaluate. However, 2” 
examination of the scoring records indicate 
that there were systematic differences in SCO" 
ing even for those responses which were cite 
as examples in the scoring manual. e 

The artificial nature of this study—the S 
of accomplices and relatively unsophisticated 
examiners, the exaggerated nature of the i 
teraction, the use of ambiguous responses o 
together with the inadequate sampling 3 
both the examiner and accomplice population 
(Hammond, 1954) limits severely the ee 
alization of these findings to nonlabora? = 
Settings of psychologists and Ss. What ie 
been demonstrated is that in giving an inia 
gence test under these conditions an adyan 
graduate student examiner will respond to e, 
way Ss interact with him and will act out a 
administration and scoring his feelings abo 
the interpersonal situation, 


Summary 


1. Eleven graduate students, each of yee 
had completed at least one course in the 4! 
ministration of individual intelligence tests, 
administered the Information, Comprehension, 
and Similarities subtests of the Wechsler- 
Bellevue II to two subjects. The test subjects 
were accomplices who acted in either a warm 
or cold role to the examiners, giving as thei! 


| 
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es memorized answers, 14 of which 
Pcs ge devised to be difficult to 
Suite ne examiner became aware of the 
Ar ae of the experiment and his data were 
five = . Each accomplice had five cold and 
tice n roles, and each examiner saw one 
cold who acted warm and one who acted 
on Each testing session was taped, al 
w le examiners were able to 
the t € tapes for both of their sessions. 
a Ypescripts prepared from these 16 tapes, 
ed examiner remark during the course of 
ae esting part of the interview was assigned 
rem of the following categories: reinforcing 
oe punishing remark, questioning alee 
stat , miscellaneous. Of the 285 examiner 
pe ements; two judges independently agreed 
n the rating of 254 of them, for an agree 
Ment of 89%. 
es The results indicated th 
ae Bees, the examiners tend 
( ient to the warm subject 
056). The examiners 
more reinforcing commen 
> 01), and to give more OPP? 
Clarify or correct responses ($ = 025) to the 


Warm subject. The magnitude of the differ- 
vo subjects was 


ences in behavior to the tY i 
Senerally small, with individual differences 
more marked than differences due to the effect 
of the interaction. 


though 
record 
From 


ed 
than the col 


also tende! 
ts (p= <& 02 


portunity to 
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MORE CONSTRUCT VALIDATION OF THE 
EGO-STRENGTH SCALE: 


IRVING I. GOTTESMAN 


University of Minnesota 


The ego-strength construct has a high fre- 
quency in the conversations and reports of 
clinical psychologists. Its origins in psycho- 
analytic theory have not deterred the tough- 
minded from its use; indeed, it was in the 
camp of empiricism that a scale purporting 
to measure it was derived. Surprisingly, Bar- 
ron’s (1953) new scale did not lead to an 
avalanche of original research either using it 
or refuting it. Barron (1956) has continued to 
work with the scale, Wirt (1955) has done 
a further validation of the prognostic utility 
of the Ego-Strength (Es) scale, and Tamkin 
(1957) and Tamkin and Klett (1957) have 
concerned themselves with its construct va- 
lidity (Cronbach & Meehl, 1955). Within the 
framework of construct validation, tests of a 
number of hypotheses about ego strength are 
reported in this paper. Es scores on samples 
of adult and adolescent normal and psychi- 
tric subjects were used. In conjunction with 
the data of other researchers, it is intended to 
form enough strands in the Es scale network 
to more nearly outline its meaning and utility. 


= Origins of the Ego Strength Construct 


As early as 1894, Freud (1924) used the 
construct of ego but did not expound upon it 
rigorously until the publication of Das Ich 
Und Das Es in 1923 (Freud, 1927). His now 


1 The author is indebted t 
the data for this study availa 
Wirt was not only the mento: 
cleared the path to data Sources and furnished the 
MMPIs for the schizophrenic sample. P, F, Briggs 
obtained access to the Hathaway-Monachesi Study 
raw data, and M. Dunnette made a sample of sales- 
managers available at the Minnesota Mining and 
Manufacturing Co. The A. H. Wilder Child Guid- 
ance Clinic, St. Paul, where the author is a fellow in 
psychology, was the source for the sample of emo- 
tionally disturbed adolescents. 


o the people who made 
ble and accessible, R. D. 
r for this paper but also 


classical topographical conception of ment 
life with its tripartite division was first ma 
there. Inasmuch as the topic of consideration 
is ego strength and not ego, this detour a 
be defended on the grounds that an abso 
concept of strength is without utility; sirme 
of any kind is relative to the current and at 
tential demands put upon it. A complete ot 
logue of ego functions would be ezten 
lengthy and partly idiosyncratic. Only S 
of the more important will be presented pee 
In Freud's definitive paper he tells us t me 
“the ego has the task of bringing the were 

of the external world to bear upon the id ai 
its tendencies, and endeavors to substitute t lë 
reality principle for the pleasure puo Ba 
which reigns supreme in the id . . . the te ar 
ing of reality is rather one of the ae same 
the ego” (Freud, 1927, p. 30). Further bee 
ing out of functions has been partly obvia jos 
by the legatees of the ego, the ego payoho 
gists, including A, Freud (1946), Barn 
(1950), and Nunberg (1948). Hartmann pa 
tures the difficulty of the task by first Ge 
ing ego negatively and then concluding t A 
it is defined by its functions: “Ego s ‘dic 
synonomous with personality, or the in ct 
vidual; it does not coincide with the ee i 
as opposed to the object of experience; an ug 
is by no means only awareness of the ee 
of one’s own self” (p. 75), The ego orgao 

and controls motility and perception (of Se 4 
as well as the world); it serves as a pora 
tive barrier against excessive stimuli; auy 
and thinking are also ego functions: it aritiea 
pates, synthesizes, and inhibits. Any comb 
nation of these functions may occur simu 

taneously. The ego must defend itself against 
id impulses, the reproaches of a punishing 
superego, and the traumata of the real world- 
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H 
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ete the above is a source and a 
in email energy to carry out the functions. 
called contexts the energy is explicitly 
and i 1 ido; it in turn emanates from the id 
oiha] posited as instinctual energy in its 
theo: a form. The available ego libido, in this 
wend Consists of the id libido that has been 
ized xualized and deaggressivized, i.e- neutral- 
‘al artriann, 1950). It follows that any 
text ence to ego strength must, in this con- 
ae pertain to the amount of available libido 
jew given time. Any instrument which at- 
ae to measure this construct must be 
ie er a sample or a sign of this available en- 
ao The enormity of this task 1s evident 
ince the construct is in constant flux. The 
o that might be aimed for are situational 
e nfidence limits in its estimation. An idea 
valuation would require a balance sheet of 
Psychic energy listing the intrapsychic ani 
nterpersonal assets, liabilities, and reserves. 
ving in a Korean foxhole would be an en- 
Vironmental liability, for example, and having 
Superior intelligence ‘would be an intrapsychic 
asset, 
Barron’s (1953) conceptualization of ego 


Strength, derived from the Es scale item con- 
= se personality and intelligence test ar 
relates, involves physiologica stability an 
ealth, a strong sense of reality, feelings O 
Personal adequacy and vitality, permissive 
armii lack of ethnic prejudice, © 
Songa ontaneity, and mE 
Bence. 3 tes jen a the previous discussion 
his sampling of ego functioning may = 
comprehensive enough for content validity. 


Hypotheses 


_ If the Es scale really measu 
— be able to discrimina i 
es about whom relative €807 
ences can be made adults should 
have hi i 
igher Es scores tha ai 
cents, Normal adolescents should be highe 
than emotionally disturbed adolescents. 
delinquent adolescents shoul be betw aes 
former and the latter. Normal adults À 
be higher than psychoneurotic and P 
adults, and the second, higher than t = 
Superior adults should have higher Es 5° 


than any of the above groups. Ego strength 
has a positive erson: 


res eg! 


linear relationship to P 
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ality integration so that Es scores should pre- 
dict the same way. The item content of the 
scale suggested that a fake-good test-taking 
attitude could contribute to plus getting; 
therefore, it was hypothesized that Es was 
highly correlated with the K scale. 


Procedure 

m the Minnesota Multi- 
Inventory (MMPI) had 
d about whom relative 
ego-strength inferences could be made were 
gathered. The tests were rescored for Es and 
K. All possible # tests were made in order to 
rank the samples. A rank order correlation 
was computed between the group means for 
Es and K and for one of the subsamples. 


Samples to who 
phasic Personality 
been administered an 


Samples 
Normal adults. Hathaway and Briggs (1957) 
ormative data on some new 
MMPI scales for a sample almost identical 
with the original normative group. Their sum- 
mary statistics for over 500 males and fe- 
males on the two scales were used as refer- 


ence. 
Normal. ad 


31 boys was 


have provided n 


olescenis. A random sample of 
drawn from all the ninth-grade 
boys in the Minneapolis public schools who 
had no record of delinquent behavior. The 
raw data from the Hathaway-Monachesi 
study (1953) were the source of the sample. 

Severe delinquent adolescents. A random 
sample of 31 boys was also selected from the 
above study, all of whom had been involved 
in serious delinquencies both before and after 
taking the MMPI. 

Emotionally disturbed adolescents. An on- 


going sample of 31 adolescents who were re-` 


Table 1 
Es and K Scores for Study Samples 


Group N Es SD7 K SD 
Superior adult 21 53.33 4.32 19.90 4.07 
cere delinquent 31 47.98 4.56 13.35 3.90 
Svat adolescent 31 46.19 6.00 15.00 436 
Hs-Hy profile 21 4095 7.23 17.90 5.33 
Schizophrenic 25 30.56 $78 1512 6.30 
Disturbed adolescent 31 37.90 7.54 12.55 471 
D-Pt profile 25 37.60 6.16 13.52 3.03 
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Table 2 


Es Data from Other Studies 


Group N Es SD Investigator 

Improved VA hosp. patient 70 55.2 7.00 Wirt 

Air Force officer 160 52.73 4.05 Barron 

Graduate student 40 50.92 5.62 Barron 

Greatly improved clinic patient 9 49.66 — Barron 

Greatly improved VA hosp. patient 19 48.6 7.03 Wirt 

Normal male 226 44.33 6.21 Hathaway & Briggs 
Improved clinic patient 27 43.07 — Barron 

VA mental hygiene clinic patient 52 41.79 7.38 Barron 

Normal female 315 40.21 6.36 Hathaway & Briggs 
Unimproved VA hosp. patient 114 33.3 6.96 Wirt 

Unimproved clinic patient 16 32.75 — Barron 


ferred to the A. H, Wilder Child Guidance 
Clinic for diagnostic study was used. The 
sample was about equally divided between 
boys and girls with a median age of 14.5 
years, range, 13 to 18 years. Although all 


were outpatients, some were severe neurotics 
or psychotic. 


corporation.? 
Veterans Administration Hospital D 


D and Pt coded high (Welsh, 1948) in thes 
order were selected for study. The profile an 
not the diagnosis was the criterion for selec- 
tion. An N of 25 resulted. 

Veterans Administration Hospital Hs and/ 
r Hy profiles. The above admission MMPIs 
yielded 21 tests with scales Hs and/ or Hy 
coded high. Again the profile was the criterion 
for selection, ; 

Veterans Administration Hospital schizo- 
bhrenics, The admission MMPIs on a group 
of Veterans Administration Hospital patienn 
subsequently diagnosed as schizophrenic wer" 
selected for study. The sample consisted à 
21 paranoid schizophrenics and 4 diagnos?” 
schizophrenic reaction undifferentiated or Un 
classified, Analysis of the data showed no 
reason to handle them by subclass. The dee 
nosis of schizophrenia was the criterion fo 
this sample of 25. 


Results 


Table 1 shows the results for Es and K for 
the seven samples. Table 2 shows some of the 
data collected on Es in other studies. 

A series of two-tailed ¢ tests for the 25 


7 d 
and scores gave results which may be displaye 
Pt aer The MMPIs of all patients ad- as follows. Groups which are connected bY 
wt ey ae py chiatry service at the Min- either an Overscored or underscored line 4° 
neapolis Veterans Administration Hospital in not differ significantly from each other at the 
1956 were examined. All tests that had scales -05 level 
Superior Severe Normal Normal HsHy Se Dt pe 
Adult Delinquent Adolescent Male Adolescent 
2 Rosen, 


Ephraim. Personal communication, May 8, 1958. 


Ý 


\Atudy. [Tis previously demonstrat 
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Reg mative group of males did not differ 
ane ed from the normal adolescents. 
than fe. inquents were significantly higher 
Bohs e normal males. All of the psychiatric 
aN significantly lower than the non- 

ric groups. Some error has been left 
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in the disturbed adolescent comparisons by 
not separating boys and girls; the normative 
data showed a raw score difference between 


sexes of four points in favor of males. 
A series of ż tests for the K scores of these 


groups gave these results: 


Disturbed 


Normal 


Superior Sc 


Adult 


Hs-Hy 
Adolescent 


T ong order correlation between Es and K 
€ seven study samples was computed. 
O equalled .46; with these few pairs one of 
ee needed for significance at the .05 
Varia] nother rho was computed for the same 
agers es for the subsample of 16 salesman- 
which and a correlation of 49 was obtained, 
arr was significant beyond the 05 level. 
Ple: pe (1953) obtained 7’s of .31 for his sam- 
S of clinic patients and graduate students. 


Discussion 


S Parsimonious interpretation of the results 
CEN to be that the Æs scale broadly dis- 
c ee between psychiatric and nonpsy- 
isc; ric adults and adolescents. It did not 
in riminate different degrees of psychiatric 
Capacitation. It did not discriminate delin- 
Bee adolescents from nondelinquents; and 
Faccicted in the opposite direction for a 
n tmer compared to normal adults. It showe 
0 relation to age within the limits of this 
ed utility as 
ctor of favorable response tO psycho- 
papy may be questioned, since severe ie 
‘pasta who are generally considered age 
à S for psychotherapy, did not differ signi 
antly from patients rated greatly improved. 
hi The correlation between Es and K was 
igher than that originally reported and sug- 
ee some interpretations of what Es may 
© picking up/It may reflect a defensive test- 
taking attitude and the ability tO recognize 
Socially desirable descriptions of personality- 
Both of these behaviors show contact with 


an testing of reality. Inasmuch as €80 de- 
ense and reality testing are both es? me 
o as- 


tions, the scale would measure these twi 
pects of ego strength. It would, however, 
indicate strength if the defense were not car- 
ried to an extreme. Reacting to the threat © 


only 


Normal Severe 


Male 


D-Pt 


Delinquent Adolescent 


not being selected for a job and reacting to a 
threat from persecutory delusions would both 
contribute to plus getting on the Es scale. An 
easing investment of energy in the defense 
ventually reaches a point of di- 
The process detracts from 
for other ego functions such 
as integration and reality mastering, thus a 
very high Es score would reflect weakness in- 
stead of strength. An empirical suggestion for 
the point of diminishing returns for clinic and 
hospitalized patients comes from the Barron 
(1953) and Wirt (1955) prognosis studies. 
Groups above or below a raw Es score of 
about 49 showed less improvement than those 
near this score. 

The significantly higher Zs scores for severe 
delinquents relates to Barron’s (1956) finding 
of a cluster of Q sort items descriptive of ag- 
s, power-orientation, and disregard 
of the rights of others, which correlated posi- 
tively with Zs scores on his Air Force officer 
sample. If added to this line of reasoning are 
the high mean Es for the salesmanagers to- 
gether with the knowledge of above average 
scores on Pd for them, the delinquents, and 
the officers, another interpretation of Es is 
suggested. The scale may be a sign of psychic 
energy per se, whether it be thought of as 
coming from the ego or the id. The inference 
as to source in any particular instance would 
be based on the case history materials and 
the rest of the MMPI profile. Without addi- 
tional information, psychopaths might be 
false positives in selection of good bets for 
psychotherapy. 

Using Es scores in profile analysis to sup- 
plement information provided by the othe 
scales is suggested by some of the data that 
now exist. A combination of high K with hi z 
Es in nonhospitalized subjects implies defen 


incre 
of the ego € 
minishing returns. 
the energy needed 


gressivenes: 
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siveness with the intent to appear socially de- 
sirable. In psychiatric patients the same pat- 
tern suggests ego syntonic behavior and a 
refusal to undertake psychotherapy or, if un- 
dertaken, lack of Cooperation in the process, 
A high Es combined with a high Pd suggests 
freedom from intrapsychic conflict; the ag- 
gression and hostility in the Personality are 
ego syntonic. A low Es combined with a high 
Pd suggests that the hostility is not ego syn- 
tonic and that the subject may be an acting 
out neurotic. All of these clinical hunches have 
yet to be verified but are 


to assess ego strength 
of a few of 


Irving I. Gottesman 


chiatric groups. Suggestions for other inter- 
pretations of what the Es scale may be doing 
were made, as were suggestions for its use in 
Profile analysis. 


Received June 27, 19358. 
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aN uei 
uraa Check List (ACL) is a test 
search. E. ough (1955) for personality re- 
be selectiv sae mer 300 adjectives which can 
of an Sg F 4 checked as being characteristic 
vantages s avior. Gough suggests three ad- 
Scope of beh this type of measure—a wide 
miliar word avior can be evaluated, the fa- 
the rater s provide a meaningful task for 
De e and the presence-or-absence check- 
one de onse assures analytic ease. However, 
typic ae of the check list as it 1S 
tion ak used is that it provides informa- 
oan ich is conceptually circumscribed. For 
mae? research may determine that two 
enti e of Ss are distinguishable by the differ- 
as J frequency of several adjectives checked 
ndi aracteristic. Although of interest, such 
Cia offer limited basis for behavior pre- 
ane or theory construction. 
sittin, method of increasing 
ity of the ACL would be to $ 
ne adjective clusters measuring new an 
ee behavior dimensions. LaForge and 
a czek (cited in Gough, 1950) did this by 
oad a sixteen-fold classification of interper- 
ca behaviors, while researchers at the In- 
es ute for Personality Assessment and Re- 
t arch (Gough, 1950, P- 38) developed clus- 
ers intended to measure self-acceptance and 
self-criticality. 
( Po other approach was taken b; 
958) who developed 15 need scales fo 
Se utilizing needs initially described by 
disse. (1938) and later incorporated ne 
Re Personal Preference Schedule (PPS) by 
dwards (1954). It was found that the rank 
order correlation between relative need levels 
as evaluated by the need scales and 
Was .60, significant at the .05 level. Wit 
sonal desirability held constant, the first-order 
Partial correlation dropped to 3 5, which 


the conceptual 
core responses 


y Heilbrun 
r the 


did 


not differ significantly from a zero correla- 
tion. Since there has been a limited amount 
of published validational data for the PPS, 
the rather low order correlation did not neces- 
sarily deny the usefulness of the ACL need 
scales. However, it did point out the neces- 
sity of relating need scores with external (non- 
test) criteria in way of evaluating their cur- 
rent utility for personality research. The pres- 
ent study assessed the validity of five of the 
15 need scales by relating test performances 


to such external criteria. 
Procedure 


Subjects 

The Ss for this study were 99 members of 
an undergraduate college course in psychol- 
ogy. This number included 56 females and 


43 males. 


Task 

The present scales for the ACL were first 
rationally derived by having 20 advanced 
graduate students judge which adjectives, if 
checked, would indicate a high level of the 
following needs: achievement, deference, or- 
der, exhibition, autonomy, affiliation nia 
ception, succorance, dominance, abasement 
nurturance, change, endurance, heterosexual- 
ity, and aggression. Agreement among 9 of 
the 20 judges was required for inclusion of an 
adjective on a need scale. The number of 
adjectives on these scales ranged from 19 
(succorance) through 33 (aggression). Th 
resultant adjective clusters were those id 
in a previous study (Heilbrun, 1958). Th : 
scales were later revised by having ‘19 a 
vanced graduate students judge which adje 
tives, if checked, would contraindicate a high 
level of a given need. Agreement amon; a 
of the 19 judges was required for cae 
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DEZ 
The number of contraindicative adjectives for 
each scale ranged from 7 (intraception) to 36 
(aggression) + 

A need score on the ACL was obtained by 
subtracting the number of contraindicative 
adjectives checked by S from the number of 
adjectives indicative of a high need level 
which were endorsed as self-descriptive. 


Procedure 


All members of an undergraduate psychol- 
O8y Course were given the ACL under stand- 
ard instructions on the first day of class, Ap- 


Achievement 


The following behaviors characterize the 
achievement need: 

To do one’s best, to be Successful, to accomplish 
tasks requiring skill and effort, to be a recognized 
authority, to accomplish something of great signifi- 
cance, to do a difficult job well, to solve difficult 
Problems and Puzzles, to be able to do things better 
than others, to write a great novel or play, 


+ These need keys may be obtained without charge 
from Alfred B. Heilbrun, Wa Department of Psy- 
chology, State University of Iowa, Iowa City, Iowa, 


Alfred B. Heilbrun, Jr., 


Table 1 


Comparison of Means for Validation of 
Five ACL Need Scales 
Era : i b 
Need N Mean SD af 

Achievement ot 
High 9 1289 593 212 58 ! 
Low 31 8.51 5.82 

Exhibition of 
High 24 1413 484 2133 44: 
Low 22 10.95 4.89 

Affiliation 03 
High 25 15.04 736 217 47 
Low 24 10.17 7.79 

Nurturance 03 
High 32 522 1.78 229 66 ` 
Low 36 4.05 

Abasement al 
High 26 -1.04 492 269 48 | 
Low 24 267 4.7 


r 

GPA distribution were not considered er 
Were those Ss considered who fell in the ct 
quartiles, respectively, of these distribu ; D 
The rationale for elimination was a t 
neither case was it possible for an 40° 
qualify as an HA because of the high 
cabulary standing. REA 

he Petona es of HAs on the Aee i 
ment scale were compared with the ren 
>S, and the results are presented in Ta at 
It can be seen that the high achieven 
group scored significantly higher on So 
Achievement scale than did the remainde 
the experimental Ss. 


Exhibition 
Edwards describes exhibition as follows: 


. nd 
To say witty sayings, to tell amusing Jokes Ga 
stories, to talk about personal adventures an upon 
Periences, to have others notice and comment hat 
one’s appearance, to say things just to see ae 
effect it will have on others, to talk about pers ade 
achievements, to be the center of attention, m to 
words that others do not know the meaning of, 
ask questions others cannot answer, 


It is obvious from these descriptive behav 
iors that a person with a high exhibition nee 
would seek social interactions with others, 
since their responses would be necessary for 


S 


Eeppi OO —_——_— E o 


Validation of a Need Scaling Technique 


A ooo It seems reasonable to as- 
Paa a a person would be more group 
Need eri Ae would a person without high 
terion o ition. Therefore, the validating cri- 
beot = r the Exhibition scale was the num- 
letic aoe activities (social, academic, ath- 
olini urch, etc.) of which S had been a 
feted oo from the time he had en- 
ioie school until the present. The error 
hich ced by age differences between _Ss, 
Bi eee provide a greater time span since 
the h g high school, was minimal because of 
ma omogeneous age make-up of the experi- 

ntal group (M = 21.08; SD = 3.09). Also 


an z 4 > 
thd 3 cela relationship between age and 
ibition scale scores would be necessary 
be intro- 


ee any systematic error would 
a and a performance comparison of the 
ne oungest and oldest Ss on this scale did 
; support this contention (¢ = Ol; 2S 
“on number of groups joined by those Ss 

© fell in roughly the highest and lowest 
ag of scores on the Exhibition scale was 
i ge The comparison, shown in Table 1, 

ows that high scorers on the scale were 
members of a reliably greater number of 
Sroups than were low scorers. 


A filiation 
Behaviors descriptive of 4 high affiliation 

need are: 
To be loyal to friends, to participate in friendly 
to form new friend- 


z 

roune to do things for friends, 
fee to make as many friends @ i A 
NES with friends, to do things wi tent "rite 
f an alone, to form strong attac! to write 
etters to friends. 


hments, 
of f riends 


within the previous five hom they 


would consider “good friends.” 
of a “good friend” was provided: : 
whose company you seek and enjoy and with 
whom you would be willing to discuss impor 
tant personal experiences.” Relatives were not 
included. 
The mean number of people considered tO 
be “good friends” by Ss whose scores fe 
within roughly the highest and lowest quar- 
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tiles on the Affiliation scale is given in 
Table 1. These data demonstrate a signifi- 
cantly greater number of people considered to 
be “good friends” by Ss scoring highest on the 
Affiliation scale than by Ss scoring lowest. 


Nurturance 


Nurturant be 
manner: 


To help friends w. 


haviors are described in this 


hen they are in trouble, to assist 


others less fortunate, to treat others with kindness 
and sympathy, to forgive others, to do small favors 
for others, to be generous with others, to sympathize 
with others who are hurt or sick, to show a great 
deal of affection toward others, to have others con- 
fide in one about personal problems. 


Validation of the 
tempted by relating it to the number of chari- 
table, medical research, rehabilitation, church, 
to which S had 


or educational activities 
contributed time, money, Or personal effects 
within the previous two years. The mean fre- 


quencies of contributions made by Ss falling 
approximately in the upper third and lower 
third of scores on the Nurturance scale are 
shown in Table 1. It can be seen that Ss scor- 
ing high on the Nurturance scale made reli- 
ably more contributions than did the lower 


scoring Ss. 


Nurturance scale was at- 


Abasement 


Characteristi 
need for abasemen 
To feel guilty when one does something wrong, to 
accept blame when things do not go right, to feel 
that personal pain and misery do more good than 
harm, to feel the need for punishment for wrong 
doing, to feel better when giving in and avoiding a 
fight than when having one’s way, to feel depressed 
by inability to handle situations, to feel timid in the 
presence of superiors, to feel inferior to others in 

most respects. 

The validating procedure involved the pre- 
diction of expected course grade by the ex- 
perimental Ss at the first class meeting. The 
predicted grade for each S was compared with 
his then current cumulative grade point aver- 
age, these differences providing the criterion 
measure. The specific prediction made was 
that Ss who estimated course grades markedly 
in excess of their current average would show 
Jower scores on the Abasement scale. 

The distribution of discrepancy scores was 


behaviors associated with a 
t are as follows: 
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Significance of Differences in 
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“Irrelevant” 
Lowest Quartiles 


Tab. 


Criterio; 


le 2 


n Performance of Approximately the Highest and 


of Ss on the Various Need Scales 


nt 
Achievement Exhibition Affiliation Nurturance ar 
Scale Scale Scale Scale 5 
“Irrelevant” Sa ee 1 
Criterion t t t 1 
Achievement 1.34 .80 74 a 
Exhibition -66 2.63* 78 297" 
Affiliation 59 1.90 1.88 1.01 
Nurturance 1.14 43 1.82 
Abasement 18 67 71 73 
* Si vi 
"t Significant af 2 $04 level 


check was made b 


vant” criterion pe 


continuous vy; 


the “irrele- 


is 
(one would be expected by peri i a 
would seem to support the contention t oval 
variables selected for this study are re 
validating criteria.2 


Discussion 


of 
The finding that performance on ee 
the five need scales for the ACL was. 5 give 
cantly related to its criterion varia per” 
rather clear support to this technique a that 
sonality assessment. It should be stresse inate 
the ability of a scale to reliably disor 
between extremes on a criterion amea in- 
does not necessarily mean that such s pre- 
strument would be useful for individua need 
diction. However, since the ACL and teea 
scales which are currently being inene a 
are intended as research tools, individua: Be 
diction is not a crucial factor. The ie 
current psychological research is suc s are 
group predictions or group discrimination een 
the rule rather than the exception. The q Ae 
tion of whether this technique of adjective oF 
dorsement has potential clinical utility W0 RE 
certainly seem to be premature, if not P 
sumptuous, at this stage of development. 


ten, in- 
2A sixth need scale, dominance, was pe. 
cluded in this validational study but was eer 
following the analysis of relationships of the si able 
criteria with “irrelevant” scales, Although the ship 
nance scale demonstrated the predicted Batra 
with number of elected group offices held, ne 
achievement, affiliation, and nurturance Ss a eee 
Ported significantly (b < .05) more elected o lys 
held than did Ss low on these scales, According g 
the criterion was not deemed an adequate validatin 
dimension for the dominance scale, 


nt | eee: ee 


Validation of a Need Scaling Technique 


r x 
ee of an easily administered, 
‘ional ecuey scored measure of motiva- 
Wain atus is evidenced by the expanding 
aor the Manifest Anxiety scale de- 
in develo y Taylor (1956). The current goal 
ossibilities f the need scales is to expand the 
Since Hs for group motivational research. 

were obt our of the five validating criteria 
mental Aoa by verbal report of the experi- 
be rai T the question of dissimulation could 
Seem = a There are two factors which would 

o curtail the influence of this source of 


er z 
. rror, The first is that Æ was also the class- 


oa instructor, and it was felt that a rather 
eR ea existed at the time the autobio- 
facto ical material was obtained. The secon 
aad is that Ss were required to make their 
and nses explicit by naming groups, friends, 
eee of donations. Accordingly, dis- 
toa on under these circumstances would have 
the pproach outright prevarication. In light of 
mat rapport, promised confidentiality of the 
rs erial, and a frank exhortation for honesty 
Y E, deliberate distortion should not have 
een a major source of error. 
Dissimulation on the ACL, when it is ad- 
ministered as a self-descriptive task, still re- 
mains a problem. It has been demonstrated 
(Heilbrun, 1958) that frequency of endorse- 
Ment for adjective need clusters is highly 1e- 
lated to judged social desirability of the ad- 
jectives characteristic of these needs. The ex- 
tent to which this source of test performance 
variance contributes to predictive error is not 
clear, since it seems defensible that 
Some human social behavior is also 
lated to a person’s judged desirability of the 


Ee in question. Thus, merely because 
est performance is determined to some ex 
alternatives does 


tent by desirability of test 

Not preclude behavioral prediction. Ho 
the extent of the correlation between fre- 
quency of adjective endorsement an 

Social desirability of the adjectives (P = ° 


Suggests that error is involved. ae 
search is necessary to evaluate the magn! 
desirability fac- 


of testing error introduced by 
tors and to investigate corrective procedures 
on the ACL. 
Summary 
9 col- 


related performance of 9 


This study 
ionally derived need scales 


lege Ss upon five rat 
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for the Adjective Check List to appropriate 
validating criteria in way of evaluating the 
usefulness of this mode of objective person- 
ality appraisal. 

High achieving Ss, as defined by relatively 
high grade point averages with estimated in- 
telligence held constant, scored significantly 
higher on the Achievement scale than did Ss 
who did not show this characteristic. 

High scorers on the Exhibition scale had 
entered into significantly more group activi- 
ties than had Ss scoring low on this scale. 

Ss with high scores on the Affiliation scale 
had met a reliably greater number of people 
within the previous five years whom they de- 
scribed as “good friends” than had Ss with 
Jow scale scores. 

High performers on the Nurturance scale 
had made a reliably greater number of con- 
tributions of time, money, Or personal effects 
than low performers. 

Ss who, when asked to predict their course 
grades, made predictions markedly in excess 
of their current grade point averages scored 
significantly lower on the Abasement scale 
than Ss who showed smaller discrepancies. 

Adequacy of the validating criteria was in- 
dicated by the failure to find clear relation- 
ships between these criteria and those scales 
for which they were “irrelevant” in this study. 

The findings were seen as indicating the po- 
efulness of this technique of objec- 


tential us 
measurement in personality research. 


tive need 
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THE SCREENING VALUE OF THE CORNELL 
MEDICAL INDEX 


M. POWELL LAWTON 1 


Norristown State H, ospital, Norristown, Pennsylvania 


proved particularly 
all self-administering 
least threatening to the average person. The 
nonthreatening quality, which undoubtedly is 
due to the medical orientation of most of the 
questions, is especially 
must select emotionally disturbed persons 
from a population 


The authors of the test have provided some 
confirmation of the former 


been investigated, is particu 
the test is to be 


1 This study was initiated while the aut 
the Veterans Administration Hospital, 
Rhode Island. 


hor was at 
Providence, 


The present study attempted to eben 
(a) whether the CMI actually discriminates 
degrees of maladjustment, (b) what are t 
best indices for such discrimination, and a 
whether chronic illness is a variable that ten F 
to weight scores in the direction of psycho 
pathology. 


Procedure 


A rough order of “likelihood of nervous 
symptoms” was arrived at in the following 
manner. CMI blanks were given to 116 col 
secutive male veteran admissions to a one 
hospital (excluding those who were aes 
ill or uncooperative), and to 34 consecuti ‘c 
nonpsychotic admissions to the psychiatri 
service. The treatment files on each aT A 
for present, as well as past, admissions to fu 
hospital were consulted, and after care s 
reading of all available data the patient Wen 
placed in one of the following four erg are 

I. Patients whose records contained no m 
mation of any psychological disturbance z 
the presence of any illness considered “psy 
chosomatic” (N = 43). cel 

II. Patients whose records contained eit A 
some notation by a physician of neryatsni # 
or tension * (N = 17) or an official diagnos ; 
of an illness mentioned as showing promin 
emotional concomitants by Weiss and Engis 
(1949) (N = 21).? Since such a spontanan 
evaluation by a Physician might refer SF 
“nervous” trait either in the normal or t s 
pathological range, and since a “psychoso 
matic” diagnosis implies greater likelihood 0 

? Typical physicians’ comments were “marked ene. 
tional lability,” “feels tense and jittery,” “a rathe 
nervous individual.” š 

2 This psychosomatic group consisted of 15 case 
of peptic ulcer, 9 essential hypertension, 3 diabetes 


mellitus, 3 bronchial asthma, and one migraine head- 
ache. 
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KS 


ne aaa 
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Table 1 Table 2 
Age Composition of the Experimental Groups Cumulative Percentages of Total Score by Groups 
Group y Mean Sigma Group Group Group Group 
I = Score I II IIL IV 
7 43 30.5 15.71 = 
1 48 43.5 14.93 10 i+ 85 92 97 
IV 25 42.6 11.52 20 42 62 72 85 
Al 34 40.2 11.94 25 40 47 52 82 
nous 150 41.5 14.07 30 26 40 5 16 
——— es A 19 34 40 71 
~ ——S—— i 40 19 17 40 71 
emoti 50 9 11 28 62 
i ee symptomatology than absence of 60 5 6 8 35 
medical diagnosis, it was believed that 70 2 2 4 18 


es ape device should detect more 
Group I. ed individuals in Group II than 1" 
bhatt pro who were at that time hos- 
and Si on the medical and surgical services 
nosis ose records indicated an official diag- 
Previ oa psychiatric condition, either for the 
eae hospitalization or on previous occa- 
tient (N = 25), It was reasoned that the pa- 
to whose disturbance was marked enough 
oe an official psychiatric diagnosis 
s more likely to show & wide range of 
ymptoms than patients in Group I. 
ra Patients at the time hospitalized on 
€ psychiatric service (N = 34). They should 
td show a wider range of disturbances 
Ses those in Group III, whose psychiatric 
isability was probably not causing their hos- 
Pitalization at the time of taking the test. 
Thenever a patient’s record showed 
=“ applying both to GrouP I we 
roup III or Group IV, he was placed in the 
one of greater maladjustment. 
ering of degree of maladjustment, 
Tough, seems logically defensible 4 
advantage of being unbiased and 
objective. 

Table 1 lists the compositio 
An analysis of variance an 
dicate that the age means 
not differ significantly amo! 
much as education has been 
related to CMI scores (Brodm: 
Lorge, & Wolff, 1953), it was " 
in this study. 


ng groups- 
shown to be un- 
an, Erdmann, 


ot considered 


Results 


The authors suggest (Bro! 
that psychiatric illness be suspected 1 


tient’s CMI protocol is characterized by one 
or more of: the following signs: (@) Total 
Score (number of Yes responses) 30 or more, 
(b) Page 4 Score 3 or more (“Moods and 
feelings” items on page 4 of the question- 
naire); (c) Sections I and J Score 3 or more 
(questions dealing with fatigue and frequency 
of illness) ; (d) Omit, etc., 4 or more (Ques- 
tions Omitted, answered both Yes and No, or 
with changes Or comments added). In addi- 
tion, the discriminating power of the follow- 
ing indices of maladjustment was evaluated 
py classifying as pathological any patient who 
showed (e) Areas Score—7 areas or more 
among the “body complaints” with more than 
one Yes response (questionnaire pages 1-3); 
(f) Page 1-3 Score 28 or more (body com- 
Jaint questions). 
(a) Total Score. The cumulative percent- 
age distribution of Total Score is indicated in 
Table 2 for the four patient groups. For every 


Table 3 
Cumulative Percentages of Page 4 Scores by Group 
= = = 
Group Group Group Group 
Score I Il TL IV 
0 60 67 84 
1 51 60 76 38 
2 35 50 60 79 
3 26 48 54 79 
4 21 42 at 79 
5 21 37 44 79 
b 19 31 40 79 
7 19 31 40 79 
8 16 27 24 76 
9 16 23 16 71 


| 
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Table 4 
Median Scores on C.M.I. Measures and Percentages of Patients Pathologically Diagnosed by Each Measure | 
Measure 
~ te -3 
Total Score Page 4 Sect. I & J Omit, ete. Arcas Page 1 
Group Median % Median % Median % Median % Median % Median % 
i pees = ma 5 23 
I 18 26 2 35 0 30 0 16 t 33 15 
Ir 23 40 2 50 T 35 1 33 5 45 e 
III 26 48 4 60 3 34 1 24 6 64 2 
IV 53 76 17.5 79 7 r 2 35 8 7% 34 
if 
Chi square 20.4 15.8 £7 3.84 16.9 E 
$ <.001 <.01 .01 >.05 <.001 h 


manner: the percentage of Yes responses be- 
comes greater as the Sroups increase in likeli- 
hood of emotional illness, 

(b) Page 4 Score. Table 3 lists the cumu- 
lative Percentages of Yes responses on Ques- 


pre- 
statistically ran- 


Group II showed 60% above, Group III 


ese differences 
> 01 level, but the pre- 


for Groups II and III. 
(e) Areas Score. 


the groups. 


(f) Page 1-3 Score, Column 6 of Table 4 
indicates that this index, while stil] giving 


significant disctimination among groups, v 
less efficient than either the Total Score 
the Page 4 Score, rbi- 
Chronic illness was defined in a rough, a ill- 

rary fashion as being either (a) episodin ka 
ness severe enough to have caused at sent 
two hospitalizations previous to the p vent 
one or (b) the Present illness having ate 
or at some previous time lasted for a pe Bi 
of one year or more, with some vere ae 
disability. By these criteria, 23 patia Til 
of the 116 Comprising Groups I, II, an 
were classified as having chronic illae 
chi square test indicated that the ihe: 
of Group I patients in the chronic i the 
8toup did not differ significantly bone 
Proportion of Group I patients an these be- 
group. Therefore, there was no citer 
tween the chronically ill and the eer 
cally ill in the presence of overt i illness 
thology. Each patient having a chronic i nic 
was matched with a patient without chi 
illness of the same group and age. In bos 
score, 52.1% of chronic patients scored a ti 
the median, while 47.9% of the yeahs, 
patients scored above the median (p > wand 
No difference was found between chronic A 
nonchronic patients in Page 4 Score (Og 
:05), also using the median test (Mo 
£952), 


Discussion 


The CMI is apparently able to distinguish 
between degrees of emotional illness. It see ct 
reasonable to think that had a more TA 
criterion of maladjustment been used, the di 


Screening Value of Cornell Medical Index 


‘ven sharper. 
an ction of Table 4 reveals that for the 
groups sample, best discrimination among all 
the Pa was provided by the total score and 
of Table 4 Score. The frequency distribution 
Score Rice indicates that the use of total 
eighten 5, 40, or 50 as cutting points would 
Psychiat the discrimination between known 
tients re ic and presumably nondisturbed pa- 
ne sore ot 50 identified 60% 
tients ar Ie of known male psychiatric pa- 
1952. ile in other studies (Brodman et al., 
is s Arnhoff, Strough, & Seymour, 1956) 
6% core identified only about 45% and 
ier Se aed Since both of these ear- 
of the ies used outpatients, the higher scores 
more present group could conceivably reflect 
severe illness in the hospitalized psy- 


Chiatric population. 
a the other hand, if best discrimination 
‘surgics patients admitted for medical and 
is de al conditions (Groups I; II, and MI) 
iere the use of a cutting score of 20 is 

430 ated by Table 2. The cutting score of 

Originally suggested by the test’s authors 
rodman et al., 1955) would seem to give 

ee over-all discrimination. Likewise, 
scor Table 3 it ig seen that while cutting 
cores of 6, 7, or 8 on mood and feeling items 
ah best separation of the extreme groups, 
e authors’ suggested score of 3 seems to be 

Meferable when attempting to pick out emo- 
lonally disturbed medical and surgical pa- 
tients, 

i These results reinforce the Sv i 
interpretation of screening devices be varied 
according to the population tested and the 
Purpose for which they are used (Meehl & 
Rosen, 1955). For instance, the present Te 
sults, when compared with other studies (Arn- 
hoff et al., 1956; Brodman et al: 1954; 
1952a; 1952b), suggest tentatively that V.A. 
medical and surgical patients, sychiatric out- 
Patients, and psychiatric inpatients may ten 
to receive higher scores than nonveteran 
populations. Though much larger samples 
would be needed to establish the existence 0 
such broad population differences, the present 
study suggests that different cutting scores 


may be better for V.A. populations. 
In view of the low frequency of occurrence 
s 


e suggestion that 
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of the Omit, etc., sign, and a failure to vali- 
date them when each was considered sepa- 
rately (Arnhoff et al., 1956), the present 
study indicates that lumping them all to- 
gether and considering a single occurrence as 
possibly noteworthy may be of value. Prob- 
ably this signis most efficient as a gross in- 
dicator of psychopathology, inasmuch as the 
intermediate groups were not ranked in the 
predicted order. 

Lack of information on the base rate of 
emotional disturbance in V.A. general hos- 
pitals makes interpretation of the predictive 
value of the CMI difficult. However, it is 
probable that a high proportion of admissions 
to general hospitals have some degree of ob- 
servable psychopathology, judging by such 
data as Zwerling, Titchener, Gottschalk, 
Levin, Culbertson, Cohen, and Silver (1955). 
Even if it is assumed that all patients in 
Group I are, as the criterion indicates, psy- 
chiatric “normals,” a maximum false positive 
rate of 209% was obtained (Table 4), while 
the false negative rate was 24% among Group 
IV. Under these conditions, use of the CMT 
would improve upon base rates if the pro- 
portion of maladjusted patients admitted 
were as low as 1:4 (Meehl & Rosen, 1955). 
The ability to pick out a fair proportion of 
probably maladjusted individuals from a large 
group makes the CMI valuable in one of its 
prime functions, that of serving as a criterion 
for the inclusion of subjects in “normal” re- 
search populations. 

Finally, a preliminary determination of how 
and to what extent chronic physical illness is 
confounded with emotional illness in the ele- 
vation of CMI scores was made. In this group 
when both age and degree of overt maladjust- 
ment were held constant, chronic illness in it- 
self did not seem to inflate CMI scores. Should 
this conclusion be confirmed in future work it 
would add strength to the assertion that high 
CMI scores are mainly a function of eee 
pathology and that use of the CMI as a psy- 
chiatric ree ot? device in a general meic 
setting does not risk inordi 
false E e dinate numba 

Summary 

The value of the Cornell Medical Index as 
a psychiatric screening device in a general 
medical hospital was investigated. An ordinal 
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scale of presumed degree of emotional illness 
was obtained by classifying 116 consecutive 
medical and surgical admissions as (I) with- 
out evidence in their records of psychiatric 
disorder, (II) presence of clinically noted 
tension or psychosomatic disorder, (III) pres- 
ence of clinically diagnosed psychiatric dis- 
order. A further group of 34 consecutive 
psychiatric admissions constituted (IV) the 
“most probably ill” group. Various CMI 
scores as suggested by the authors were 
studied, and it was found that these scores 
consistently ordered the four groups in terms 
of measured psychopathology, as predicted. 
Most of the authors’ suggested cutting points 
were confirmed, but there was some ev 
that different cutting points would be 
able for different purposes. In a small s 
of 23 cases, it was found that prese; 
chronic illness did not by itself increase the 
likelihood of psychiatric diagnosis by the 
CMI. It was concluded that the CMI is valu- 
able both as a screening device for choosing 
groups and as an individual test. 


Received July 7, 1958. 
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SYMBOLISM VALIDITY AND LEARNING WITHOUT 
AWARENESS 


CAROLINE TAYLOR MACBRAYER 
Davidson College 


eer publication, Levy (1954) re- 
versal vidence against the existence of a uni- 
the oh oon symbolism and warned against 
hei practice of assuming, in blind 
sexual of projective materials, that universal 
statem symbolism is a valid concept. Levy s 
should no (1954, p. 45) that his results 
Teed ue be generalized to any great extent 
8rade = experimental population of fifth- 
emph children, plus continued and renewed 
eg on sexual symbolism in current re- 
chief (Clark, 1955; Hall, 1953), were the 
stimuli for the present investigation. 

pot two purposes of the present experiment 
tive o determine whether Levy’s (1954) nega- 
conclusion concerning the existence of a 


Universal sexual symbolism of the Freudian 
for college stu- 


ther learning of 


the meaning of symbol tion to sex, 


Without awareness of W. 
can be experimentally pro 
aim was suggested by CU 

learning without awareness of what is being 
learned (Cohen, Kalish, Thurston, & 
1954; Greenspoon, 1955; Philbrick 

man, 1955; Postman & Jarrett, 1952), esp- 
cially the experiment by post 
man (1955), which showe 
simple task facilitates learnin; 
ness. 


Essentially, the present experiment is 4? 


investigation of the influence of unconscious- 
ness, as defined in at least two of the 16 ways 
discussed by Miller (1942, PP: 21-44), 0P 
the responses of subjects (Ss) to sexual sy™- 
bols. A strictly psychoanalytic concept of un- 
consciousness (Miller, 1942, pp- 42-43) was 


used by Levy (1954), who found that un- 
conscious classical or Freudian sexual sy™- 


bolism did not produce significantly greater 


learning by the paired-associates technique in 
one group of fifth-grade children, for whom 
boys’ first names were paired with abstract 
“male” figures (long, pointed) and girls’ first 
names were paired with abstract “female” fig- 
ures (round, containing), as compared with 
another group of fifth-grade children, for 
whom boys’ names were paired with “female” 
figures and girls’ names with “male” figures. 
Levy (1954) also found that these same chil- 
dren did not pair the five girls’ names with 
the five female figures or five boys’ names 
with the five male figures at a significantly 
better than chance level. 

The present study is designed in a simi- 
lar, but somewhat more extended and rigor- 
ous, manner to investigate this same psy- 
choanalytic concept of unconscious sexual 
symbolism. It also attempts to investigate 
unconscious learning during the experiment; 
unconscious learning being defined here ae 
learning without awareness of what is being 
learned (Miller, 1942, pp. 43-44), or learn- 
ing without being able to communicate or 
verbalize what has been learned (Miller, 1942 
m8_41 and p. 292). Hypotheses to be 
tested by the experiment are as follows: 

1. Classical or Freudian unconscious sexual 
symbolism is valid for male college studenits 

2. Learning of the characteristic or charac- 
teristics of maleness or femaleness of abaisant 
figures can occur without awareness on thi 
part of the S of what is being learned ° 
In addition to testing these two hypothese: 
the present experiment aimed to deem n 
within the current experimental proced $ 
whether unconscious classical sexual E 
bolism, or learning during the aoa 
without awareness of what is hanp leat 
is a stronger determiner of responses t a s 
stract sexually symbolic figures. Dae 
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Method 


Ss were 80 male college students in a men’s 
college, none of whom had taken a college 
Course in psychology. They were divided into 
four experimental groups, each of which con- 
tained 20 Ss. The 13 freshmen, 23 sopho- 
mores, 34 juniors, and 10 seniors were as- 
signed at random to one of the four experi- 
mental groups, the number of Ss from each 
class in each of the four groups being roughly 
equivalent. 


follows: 
First Memory Second M, 
Group Task Task mee 
1. MacBrayer figures, Levy figures 
3 
correct reversed 
2. MacBrayer figures, evy figures, 
reversed correct 
3. Levy figures, MacBrayer figures, 
correct reversed : 
4. Levy figures, acBrayer figures 
reversed correct i 


Materials were 


presented in mimeographed 
form. One minute 


was allowed for memoriz- 


1 Two figures were slightly modified. 
2 Available on request from the author, 


Tee 


MacBrayer 


ing the names of the 10 figures in the first 
task, followed by a three-minute recall period 
during which the same figures were presented 
in a different order and S was asked to write 
the names of all the figures he could recall, 
guessing for those which he could not recall. 
At the end of this three-minute recall period, 
the same Procedure, using S’s second memory 
task, was repeated. The experiment was pre- 
sented to Ss as a study to determine how 
much ability to memorize improves during the 
four years in college. Each S was asked to put 
his class but not his name on his paper. Im- 
mediately after completion of the test, Ss were 
asked to comment on anything they had no- 
ticed about the experiment, such as the na- 
ture of the figures or anything they thought 
the test might measure in addition to ability 
to memorize. Four Ss were eliminated from 
the experiment because they verbalized the 
Principle at least partially, and four Ss were 
eliminated because they made no errors un- 
der either correct or reversed conditions; the 
data for these Ss are not included in the E 
sults of the 80 Ss reported in the present eX 
periment, 


Results 
is 
Results are Presented in Table 1. THEA 
clearly no significant difference in memory 


names of figures under correct as compared t0 
reversed conditions. In other words, memory 
for names of figures is not significantly fa 
tated by boys’ names being paired with male 
figures and girls’ names with female figures, 
rather than vice versa. This agrees with Levy i 
(1954) findings for fifth-grade children, whic 
was interpreted by him as evidence agains! 
universal sexual symbolism, Levy assume 
that if universal sexual symbolism exists; 
Positive transfer effects in memorizing woul d 
tesult from correct Pairing of figures an 
names and negative transfer effects from iter 
versed pairing. While these data reveal no Gee 
dence for classical sexual symbolism validity: 
an analysis of the nature of the errors in the 
Present experiment, under “forced guessing 
Conditions, reveals a different story. 

Under all conditions, a significantly greater 
number of guessed (that is, incorrect) names 
were of the same sex as the name which had 
been paired with the figure in the material 5 
had attempted to memorize, This is inter- 
preted as evidence of learning Without aware- 
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Table 1 
Errors in Recall of Names of Abstract Figures 
(Ss: N = 80) 
= Condition AM No. or Proportion of Errors tor p 
Name: i oe 7 a 
eey et (c) vs. names reversed (r) Me = 2.75 M, = 3.01 1= 92 = 
Alle errors (s) vs. opposite-sex errors (0)* 
on ‘onditions M, = 1.87 My = 1.01 <.01 
Ree condition M, = 1.95 My = .80 <.01 
ee condition M, = 1.79 M. = 1.22 <.05 
oe ae of opposite-sex errors under correct (c) 
versed (r) conditions b= -29 p= Al z = 3.64 <.01 
a 
the på same-sex error is a ssed name of the figure is of the same sex as the name paired with the figure i 
X eee S attempted gne inwhifch Ahe gu rosite-sex Crror is one in which the guessed name of the figure is of the aenusite 
the name paired with the figure in the oeaterial S attempted to memorize. 


n 
i ee what has been learned, ie., SS learned 
Elistic ce had the characteristic oF charac- 
Ben AA maleness or femaleness, aS evi- 
e f y the sex of their guessed names for 
the ies without being able to verbalize 
Were ale principle on which et a 
Ypothesis. This finding supports the 5 
Sex Ae analysis of sam 
tions eg reveals that un 
ame e number of same-se 
Was te figure same sex as 
rors ignificantly greater 
, at better than the - 
er reversed conditions, this difference iS 
Marked, being significant at better than 
05 level, but below the 01 level of con- 
SI SS Ce. Translated into proportions of oR 
Teves errors under correct as compared. : 
ence sed conditions (see Table 1), this i is 
oe is highly significant. This is interprete 
Sic P Pporting the first hypothesis, i 
i a Or Freudian unconscious sexual symbol 
Nt] is valid for male college students. Appar- 
Y, when Ss cannot recall the name 0 
Ste there is no interference by classical un- 
gu cious symbolism with guessing names 0 
net which are the same sex aS the figure 
aire in the memory task, if the memory tas! 
Se girls’ names with female figures an 
te names with male figures. If, however, 
gane aired names in the memory task were 
u unconscious sexual symbolism does 
are ere with guessing names of figures whic 
of the same sex as names paired with the 
pees in the memory task, and a significantly 
pee proportion of opposite-sex errors oc- 
a under reversed Conditions. These oppo- 
e-sex errors under reversed conditions are; 


e-sex and opposite- 
der correct condi- 
x errors (guessed 
in memory task) 
than opposite-sex 
01 level, whereas 


Esg 
the 
ie 


of course, errors in which girls’ names are 
guessed for female figures and boys’ names for 
male figures, in accord with classical sexual 
symbolism, despite the fact that in the mem- 
ory task the sex of the names given to the fig- 
ures had been reversed. 


Discussion 


Evidence for the validity of unconscious 
sexual symbolism was found in the present 
Apparently, its operation is at a 
of unconsciousness than that in- 
vestigated by Levy (1954). Its influence on 
responses to sexual symbols was found to be 
relatively weaker than the influence of un- 
conscious learning, or learning without aware- 
ness, Which took place during the experiment. 
Thus, when Ss have attempted to learn names 
for figures which are of the opposite sex than 
the classical sexual symbolism of the figure 
and are required to guess for unrecalled names 
of figures, their guessed names are signifi- 
cantly more often of the same sex as those 
they attempted to memorize. At the same 
time, opposite-sex errors intrude significantly 
more often under these conditions than when 
paired names in the memory task are of the 
same sex as the classical sexual symbolism of 
the figure. 

That unconscious learning during the ex- 
periment was a stronger determiner of the 
sex of guessed names of abstract figures in 
the experiment than was classical unconscious 
sexual symbolism may be due to several fac- 
tors. Learning during the experiment, although 
Ss were unaware of or unable to Serbaliz 
what had been learned, had the advantage i 
greater recency and probably of aA 
tivation (Miller, 1940), in the sense that Se 


experiment. 
deeper level 
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consciously wished to do well, which would 
be an indication to themselves of their own 
ability or intelligence. Furthermore, classical 
sexual symbolism has the disadvantage of re- 
pression, at least during ordinary waking con- 
ditions, whether repression is regarded in clas- 
sical psychoanalytic terms (Miller, 1942, pp. 
234-239) or simply as avoidance condition- 
ing (Eriksen & Kuethe, 1956). While it is 
certainly impossible to say how deeply un- 
Conscious classical sexual symbolism is, it 
Seems safe to assume that in the hierarchi- 
cal continuum of imperceptible gradations 
between Consciousness and unconsciousness 


136-137), it lies further 


or became communicable, 


were eliminated from the 
experiment, 


This interpretation of 
data agrees in principle 


approaches a supraliminal 
level (McConnell, Cutler, & McNeil, 1953 
p. 23 Pparently, 


unconscious learning 
ore nearly approached 


Summary 


An experiment was done to determine 
whether classical sexual symbolism is valiq for 


Caroline T. MacBrayer 


male college students. No 
that memory for names > 
was better when boys’ names were paired 
with “male” (elongated or pointed) ab- 
stract figures and girls’ names with “female 

(rounded or containing) abstract figures than 
when the names were paired with the figures 
in a reverse manner. However, evidence in 
Support of the validity of classical sexual sym- 
bolism was found in the nature of the errors 
or guesses of names for figures which Ss could 
not recall. Even stronger evidence was found 
of the influence of learning during the experi- 
ment without awareness of what was being 
learned. Possible reasons were discussed for 
the relatively greater influence of unconscious 
learning during the experiment than of un- 
Conscious classical sexual symbolism on an 
sponses during the experiment to abstrac 

sexually symbolic figures. 
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evidence was found \ 
y 
of abstract figures 
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THE SOCIAL DESIRABILITY OF TRAIT DESCRIPTIVE 
TERMS: 


APPLICATIONS TO A SE 


EMORY L. CO 


(0; 
: formal Pri tien of recent research on the 
)'8 the gro a ig of verbal response behavior 
With C conviction, by those concerned 
(Ss?) res ems of assessment, that subjects’ 
ve ee to personality inventories may 
€m cont ced by factors quite extraneous tO 
Teports a ent. Illustratively, Edwards (1953) 
ability pe na of .87 between the prob- 
Striptive endorsement of a personality de- 
( statement and its social desirability 
Amon Pite such empirical findings, the 
Seems Big available personality inventories 
May Fen proliferate rapidly. This, 1P part, 
ogethe, See a seeming simplicity in putting 
sibly aN a series of verbal proposit 
cal y, apping almost any type of psychologi- 
the parabl, Considerably more difficult is 
in oe of demonstrating that the variable 
Vetbal eon is actually being measured by the 
ing t responses given to the items purport- 
We easure it. 
ae the development of g 
1949 ology” (Rogers, 1951; Snyg 
) there has followed the inev 


modern phe- 
g& Combs, 
itable rash 


hew j 1952; Bills, 

V. instruments (Berger Ate 

pace, & McLean, 1951; Brownfain, 1952; 
ing to as- 


Cey, 1954; Phillips, 1951) presumits 


ESg i 
tam variables of prime import , ' 
e of reference. Typical of this grouP ° 


M 

sant and Values (Bills, 1 

ives Of a series of 49 trait i 

Self oe of which is rated three ti 

on a Oncept, self-acceptance, an 
series of five-point scales. 

nted in an ad- 


a? 
ortions of this paper were prese 
in Washington, 


ess = 
: c to Div. 8, at the APA meetings 
eN August 1958. 

ow at the University of Buffalo. 


dri 
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LF-CONCEPT INVENTORY ' 


WEN AND PHOEBUS N. TONGAS °? 


University of Rochester 


tion is made, based on the underlying theory, 
that the higher the self concept (SC), self- 
acceptance (SA), and ideal self (IS), the 
better adjusted is the S. A fourth score, the 
maladjustment index, is derived from the 
summed discrepancy (D score), without re- 
spect to sign, between SC and IS. Since a 
discrepancy between SC and IS is taken as 
an index of conflict or emotionality with re- 
spect to the trait in question, the lower the 
summed D score the better adjusted is the S 
considered to be. 
It might justifiably be expected that one 
aspect of the validation problem for an in- 
strument of this type would be to demonstrate 
that Ss with high SC, SA, and IS scores or 
low D scores are, in fact, better adjusted than 
their opposites on some independent measure 
of adjustment. Although there has been a 
reasonable amount of “validation research” 
reported for the IAV, the preceding expecta- 
tion has not always been borne out. Illustra- 
tively it is reported (Bills et al., 1951) that 
scores above the mean on SA relate in one 
instance to improved adjustment following 
participation in a student-centered teaching 
situation (as might be expected from theory) 
and in another instance to a higher incidence 
of psychotic signs on the Rorschach (quite 
contrary to theoretical expectations). Subse- 
quently in a larger Rorschach study (Bills, 
1953a), a series of 32 hypotheses, dealing 
with specific test signs which might be ex- 
pected to differentiate extreme high from ex- 
treme low SA scores, was proposed. Pateni 
thetically, 11 of these 32 hypotheses called 
for no differences between groups, thus hav- 
ing a 95 probability of confirmation. Of the 
21 hypotheses, 10 yielded group 


remaining 
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differences significant at .05 or beyond. Closer 
examination of these “confirmed predictions,” 
however, indicates that in most instances the 
high SA scorers (theoretically, the better ad- 
justed group) are significantly more malad- 
justed in terms of the traditional meanings 
attached to the specific Rorschach signs in 
question (e.g., less FC, and more CF, lower 
F+9%, higher dominance of C over M, etc.). 
While it may be appropriate to conclude that 
the high and low SA scorers are differentiable 
“. . . with respect to certain important per- 
sonality characteristics as measured by the 
Rorschach” (Bills, 1953a, p. 38), such an 
empirical demonstration should not be con- 
fused with the validation of underlying theo- 
retical constructs. By and large the findings 
are opposite in direction to what might be de- 


(Bills, 1953b), the 
that words for which 
lower IAV ratings were given on a second test 
administration would also have slower reac- 


prediction. The following statement is ad- 


vanced in seeking to explain these unantici- 
pated findings: 


- . . the ability to lower a trait rating on re-test may 
be indicative of a lower deg 


therefore by a decrease in reaction tim 
free association 


If a lowered SC rating on an IAV retest 
can be construed as an į 


be due to lowered defensiveness, rather than 
to conflict or emotionality, as has been as- 
sumed. Unless procedures can be Specified be- 
fore the fact, by which we can discriminate 
the high SC score Tepresenting good adjust- 
ment from the high SC score representing de- 
fensiveness, we are operating within a closed 


Emory L. Cowen and Phoebus 


N. Tongas 


system in which the results of a given experi- 
ment, irrespective of their direction, can be 
interpreted as confirming the underlying the- 
ory. Hence, Bills’ (1953b) conclusion, on the 
basis of the experiment cited, that “. . . the 
index is a valid measure of emotionality and 
changes in emotionality” (p. 137) appears to 
be somewhat premature. When an instrument 
yields significant findings opposite in direc- 
tion to what might be predicted on the basis 
of its underlying theory, it may well be ara 
criminatory, but it is not valid in the sense s 
offering support for the relevant theoretica 
concepts. Aaa 

Perhaps the problem would be simplifie 
if, in some consistent way, obtained findings 
were always contrary to what may be pre 
dicted beforehand. But this does not appear 
to be the case since studies are cited on 
1958) in which high SC scores show up a 
better adjusted on other measures (e.g, 4 
sence of psychosomatic symptoms). for 

Thus far, most attempts to account OF 
findings which do not support underlying = 
ory in this area (Bills, 1953b; Fey, 1A 
have been based upon implications about t H 
Vicissitudes of verbal response characteris 
in human Ss. The maladjusted S, it is are En 
appears well adjusted because of his ae 
siveness. We may Presume that part of t a 
operational meaning of the concept peat 
ness, when it is invoked in this context, 15 Be 
tendency to respond in a socially desira 
manner in instances where a true resp 
would place the S in an unfavorable light. 7, 
yet, the extent to which social desirability 
stereotypes may account for responses to ab 
inventory such as the IAV, either for speci $ 
individuals or for a group of Ss, is undeter- 
mined. It is precisely this type of informa- 
tion which the Present research seeks to es 
tablish. 

Theoretical inconsistencies aside, the he 
of the reported validity data for the TAY 
(Bills, 1958) is in terms of demonstrated ra 
lationships between it and other similarly Co 
structed self-concept measures (e.g., Cowen: 
1954, 1956; Omwake, 1954) and/or more trej 
ditional paper-and-pencil inventories (Bills, 
1958). Such correspondences may, however; 
indicate little more than constancy in verbal 
behavior or social desirability stereotypes, and 


Social Desirability 


oe se be taken as a final criterion 
ree recently, there have been several en 
Cificall: ein theoretical papers directed spe- 
irene. oward the problem of possible re- 
oe 1ps between social desirability and 
tions (enn either of IAV type trait descrip- 
descripti enny, 1956) or closely related self- 
Mede se statements from Q-sort pools (Ed- 
enny 955, 1957; Edwards & Horst, 1953; 
study.” 1956). Most relevant is Kennys 
establi. ones in which SD rankings were 
for a shed for 25 trait descriptive adjectives 
sam eee sample. A second independent 
same oak bsequently rated themselves on these 
self © adjectives both for “real self” and “ideal 
oo eepaigpe of .§1 and .82 were Te 
for th between mean endorsement and 
Stron 3 se two variables. These data suggest 
simile y the possibility that a structurally 
Nar formal test instrument such as the 
Esse: might be highly saturated with SD. In 
pie the purpose of the present study was 
Ee, mine the extent to which this was the 
an k: Such an inquiry was made possible by 
A arlier study in the present series (Cowen, 
ca in which mean SD values for a 
ing le pool of trait descriptive terms, inchid 
est all 49 adjectives comprising the IAV, were 
ablished for a college sample. 
e hypothesis may be summ: 
po there will be a high P 
etween both mean SC 


Orsement and SD. Secondarily, 
between mean 


f the mean 
(ie., the 


arized as fol- 


ositive correla- 


SCs discrepancy and d 
mee from the scal 
like} extreme the SD of an WF 2 to 
fe ly are both SC and IS ratings 

Cted by it; hence, the smaller the 


d 
iscrepancy) (Kenny, 1956)- 


. Procedure 
A sai Ss (59 male and 
mple of 100 college SS Sp norma- 


female), independent ot 
ave Bae (ene in press), completed ra 
a IAV in group ¢ A 
is IAV adjective mean, SC, 
crepancy scores were determ 
C and IS endorsement values 


4l 


ined. The mean 
were correlated 


of Terms in Self-concept Inventory 
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with SD normative values for each trait-de- 
scriptive term. Mean D scores for each adjec- 
Jated with the departure of the 


tive were corre! 
midpoint, four, of the SD 


SD mean for the 
scale. 
For rea: 
sirable to run a si 
ple on a somewhi 


sons to be noted below it seemed de- 
econd, cross-validating, sam- 
at modified version of the 
IAV. These latter data were collected and 
analyzed exactly as the original data had 
been. The new sample consisted of 23 male 


and 26 female Ss. 


Results and Discussion 


The basic hypotheses. All analyses were 
run separately for males and females. In each 
instance, however, the findings were virtually 
identical for the two sexes; hence, all correla- 
tions are reported in terms of the total groups. 

Looking only at the data from the initial 
study we find, in support of our hypotheses, 
a correlation 


of 906 (p > -001) between SC 
endorsement and S 


D. This marked relation- 
ship is, in fact, every bit as high as the reli- 
ability of the former measure (Bills, 1958). 
An even higher correlation of .958 (p > .001) 
is observed between IS and SD. On the other 
hand, the predicted correlation between the 
sc-IS discrepancy and extremity of SD was 
not found (r=— 053). 

Analyzing the actual SD values of the 49 
IAV adjectives, it was apparent that they 
were not normally distributed in terms of the 
seven-point SD Scale used in the normative 
study. Forty of the 49 terms had SD values 
ranging from 5.0-6.7, while the remaining 
nine ranged from 1.1-2.2. This grossly atypi- 
cal distribution could theoretically have seri- 
ously affected the observed correlations. In 
the instances of the SC and IS correlations, 
the unusual bipolarity could have operated to 
inflate the relationships spuriously, while the 
clustering of 40 of the 49 terms at the posi- 
tive end of the SD continuum could have had 
an opposite effect. Additionally, since the de- 
viation of the adjectives from the midpoint 
of the SD scale was limited to a range of 
1.0-2.9, the correlation between this variable 
and SC-IS discrepancy also could have been 
restricted artificially. 

The second study was undertaken to rule 
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out the possible attenuating effects of these 
distributional atypicalities. Forty-eight new 
adjectives were selected from the original 
normative study (Cowen, in press) so as to 
cover the full range of the SD continuum 
(1.1-6.6). This, of course, also had the effect 
of increasing the SD deviation scores, the 
range going from .1-2.9. Although the trait- 
descriptive terms used for the second study 
were different from those comprising the 
original IAV, the instructions, form of ad- 
ministration, and methods of analyses were 
the same as the ones used with the original 
sample. 
The results of this second study were essen- 
tially identical to those obtained with the 
instance, the correla- 
endorsement and 
and .978 (p> 


as well as their ordering on the SD con- 

it appears that the relationship be- 

tween SC and IS endorsement and item SD 

may generalize considerably beyond the TAV 
test. 

Implications. The very high degree of rela- 


tionship between both SC and IS endorsement 
and SD raises question 


mer two have meanin 
latter. Given the know: 


concept and ideal self 
so heavily Saturated wi 
be more parsimoniou 
found to discriminate 


view, one might perh 
clude: (a) that Ss markedly influenced by 
SD stereotypes give more maladjusted Ror- 
schachs (Bills, 1953a) than Ss who do not 
respond in terms of such stereotypes, and (b) 
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that for those items where Ss’ response be- 
came more socially desirable on an IAV Live 
test (Bills, 1953a), word association reaction 
response latencies also increase. Although di- 
rect and independent test of these rewritten 
generalizations is clearly preferable to the 
Present type of speculation, they may repre- 
Sent a more parsimonious position than do the 
original generalizations (Bills: 1953a, 1953b)- 

The SC-IS discrepancy score, on the otha 
hand, appears to be quite independent 0 
the contaminating effects of SD stereotypes: 
This per se, while it does not establish the 
validity of this index as a measure of tension 
or conflict, does, at least indirectly, buttress 
the findings of other studies purporting n 
offer such evidence (Cowen, Heilizer, & Axel- 
rod, 1955; Roberts, 1952). However, den 
our attempts to maximize the range of S 
deviation scores in the second study, pe 
SC-IS D scores were limited in range rom 
-2-1.4 in both studies, Quite probably this F 
due to the fact that the IAV measure, as B 
constituted, is only a five point scale. T 
narrow range of D scores observed wou i 
tend to have a limiting effect upon the marea i 
tude of the correlation coefficient. Liat 4 
broadening the range of the IAV rating sca nee 
# Somewhat more appropriate test of the sê 
ond hypothesis could be provided. 


Summary 


-esent 
Broadly stated, the purpose of the aie 
study was to assess the degree of relations 
between endorsement of items measuring E 
pects of self regarding attitude and item 
cial desirability. r 
One hundred Ss completed the Bills me 
of Adjustment and Values. Mean self ange 
ideal self, and SC-IS discrepancies Wee 
puted for the 49 constituent trait-deseript i 
terms. The first two of these measures ete 
found, as predicted, to correlate very Di 
with independently established SD ve aig C- 
these same items. Contrary to prediction, He 
IS discrepancy failed to correlate with oe 
tion of the SD mean from the scale midpoint- 
Since the IAV adjectives were found to be 
both skewed and bipolar with respect to their 
SD values, a new series of 48 adjectives 
spread out equally across the full range ° 


the SD continuum was selected and given to 


E 
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a second sample of 49 new Ss. Using constant 
methods of test administration and analyses, 
the results obtained with the second sample 
were identical to those of the original study. 

We have concluded that the self concept 
and ideal self measures of the IAV are So 
heavily saturated with SD as to lose mean- 
ing independent of the latter variable. Some 
implications of this basic generalization have 
been considered. 
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TWO QUESTIONS: 
A REPLY TO COWEN AND TONGAS 


ROBERT E. BILLS 


Alabama Polytechnic Institute 


The Cowen and Tongas Paper seems to 
have made a significant contribution to un- 
derstanding a portion of the basis on which 
self ratings on the Index of Adjustment and 
Values (IAV) are made. For perspective, 
though, two questions should be asked. 


What Is the Index Used For? 


The first question is: 
used for? 


In the writer’s opinion, the emphasis of the 
Cowen and Tongas Paper does not reflect 
properly what has gone before in the way of 
research concerns and manner of use of the 
index. Most of the work on the index has 
centered around the “acceptance” scores, 

The primary reason for designing the IAV 
(Bills, Vance, & McLean, 1951) was to de- 
velop a measure of self-acceptance. To obtain 
this measure, Subjects (Ss) are asked to an- 
swer three questions for themselves for each 
of 49 trait words. Ss tell how they see them- 
selves in Tespect to the trait, how they feel 
about being this sort of person, and how they 
would like to be in respect to the trait. The 
second of these ratings, cumulated for the 49 
trait words, has been called acceptance of self. 
The cumulated difference between the first 
and third ratings is called the discrepancy 
score, Discrepancy Scores are correlated =i 
(for an WV of 175) or —.67 (for an N of 300) 
with acceptance of self (Bills et al., 1951; 
Bills, 1958). The distributions of discrepancy 
scores and acceptance of self scores are ap- 
proximately normal (Bills, 1958, pp. 18-19, 
22-23, 36-37, 40-41). 

For several reasons, 
Cowen and Tongas, 
“others” form of th 


What is the index 


including one raised by 
we later developed an 
e index (Bills: 1953, 


1958) in addition to the “self” form descrita 
above. One of the reasons for this was ee 
dilemma posed by high self-acceptance sol 
being indicators of either high self-accep ET 
or of defensiveness—a point which ees ae: 
Tongas also make. To complete the ot be 
form of the index, an S thinks of his TA 
group and completes the index as he e Ee 
the average member of this group wou Ei 
plete it for himself. This procedure ee 
have resolved the dilemma (Bills: i. H 
1958). A review of the literature will Se 
the reader that the validation work for an 
index has centered around the “acceptance In 
scores from these two forms of the ne 
practice, these are the scores commonly Le, 

This being the case, it does not seem n pi 
sary to determine if assumptions oe the 
three as stated in the second paragraph o by 
Cowen and Tongas paper have been made a 
this writer. Nor does it seem too inp i, 
in the IAV context, to examine the ue “ia 
normality of distribution of the social ee 
ability of the index traits. And, we will e tak 
it to the interested reader to parE sis 
himself if “the brunt of the reported vali E 
data for the IAV is in terms of demons ete 
relationships between it and other sim rate 
constructed self-concept measures and/ oe 
traditional paper-and-pencil inventories. a 

Study and use of the IAV have been se 
cerned primarily with the “acceptance” sco A 
from the “self” and “others” forms. ANGSA 
Cowen and Tongas had data on the sel i it. 
ceptance scores, they do not report Wee ac 
They did use discrepancy scores which T 
significantly correlated with selt accen i 
and it is important to note that they did ue 
find discrepancy and social desirability 
nificantly correlated. 
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What Does the Cowen and Tongas Method 
of Statistical Analysis Yield? 


The second question is this; What does 
the Cowen and Tongas method of statistical 
analysis yield? 

In the writers opinion, the Cowen and 
Tongas method is not directly comparable to 
methods previously used to report IAV re- 
search. 

The Cowen and Tongas technique for cal- 
culating correlations between self concept and 
social desirability and ideal self and social 
desirability says, in effect, that the mean of 
the ratings given by Ss for each of the 49 
IAV trait words is highly correlated with 
Bere social desirability ratings of the traits. 

is technique is significantly different from 
that used to calculate the reported reliabili- 
ties and the validity of the index. The Cowen 
and Tongas technique, in effect, ignores the 
individual variation given by raters: It says 
that the average ratings for each of the trait 
Words are highly correlated with the average 
social desirabilities of these traits. This seems 
to be saying that the average person rates 
himself as average in social desirability for 


each of the trait words. 
The Cowen and Tongas m 
pees only the mean of ratings 
all used) that the data can be 
Ss gave the average rating on 
his has the same effect as saying that all Ss 
Bie the same rating to a trait © 
aa Ss. This is obviously a questi 
umption when information given in ee 
“anual (Bills, 1958) on distribution o ia 
ings for each of the trait words © examined. 
hese data show that considerabli variation 
exists in the ratings for each trai a 
ae placing of one score (in this case an av 
oe rating) on each trait obscu 
a variation, and this is considerable. 
ut having calculated the COU”. 
4 cen self Petcare and social desirability am 
ney self and social desirability bY 
a the authors switch 
Cor; fheir implication. They compare 
fees ions with split-half al 
telia ities obtained from colun 
erotic: reported for the 
tals ted from odd-even scores O 
in test-retest situations: 


ethod assumes 
on trait words 


Cowen and Tongas arrived at an average rat- 
ing for each trait word on the index and an 
average rating of the social desirability of 
each trait word, paired these, and then pro- 
ceeded to correlate. They then compared this 
coefficient with that obtained by totaling col- 
umns for each individual and pairing column 
scores from split halves or from test-retest. 

Obviously, these two methods are not di- 
rectly comparable and the implication cannot 
be drawn that “Given the known reliability of 
the self-concept measures, as much of the 
variance as can be accounted for is accounted 
for by item SD value.” The two techniques 
yield different results as will be shown. If 
their’s is a valid procedure, it is difficult to 
see how self concept and ideal self, which are 
correlated only .55 with each other for an V 
of 300 cases (Bills, 1958, p- 62), could be 
correlated .91, 96, .90, and .98 with a third 
variable, social desirability. 

Using the formula provided by McNemar 
(1949, P- 142) and designating the r between 
self concept and social desirability as 71, be- 
tween ideal self and social desirability as 72, 
and between self concept and ideal self as rs 
and using 90 for 71 and .98 for rz, we can 
calculate the limiting values for 7s (that the 
Jd be the same if we used .91 and 


results would 
96 instead of .90 and .98 can be checked by 


the reader). In this case, the limits range 
from .78 to -98. But rs for an N of 300 cases 
as has already been stated is .55. Even with 
as few cases aS 49 (the smaller of the groups 
used by Cowen and Tongas) an ” of .55 based 
on 300 cases is significantly smaller than an ” 
of .78 based on 49 cases at less than the .01 


level of confidence. 


Received July 18, 1958. 
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A CONTRIBUTION TO THE “MEANING” OF RORSCHACH’S 
INKBLOTS VIA THE SEMANTIC DIFFERENTIAL 


A. I. RABIN 


Michigan State University 


The present paper represents an attempt to 
explore the “stimulus value” of Rorschach’s 
ten inkblots. It is concerned with the global 
“meaning” which is attributed to them by a 
group of young normal adults, 

Over-all meaning and symbolism of some 
of the inkblots has been occasionally ascribed 
intuitively by Rorschach workers. We have 
undertaken an experimental 


ed the semantic 
& Tannenbaum, 


Procedure 


Osgood’s Semantic differential Consists of 


50 scales which are defin 
tives, i. jecti 


Good Te bad 
; Factor analytic studies of the scales with 
sizable samples of subjects (Ss) rating a va- 


riety of Concepts have yielded three major 
factors: 


I. Evaluative; 
tivity. 

For the Purposes of our investi 
scales of the semantic differential were se- 
lected by the author. Two criteria governed 
this selection—trelatively high loading on the 
aforementioned factors and suitability to the 
material to be judged. The 20 pairs of adjec- 
tives employed are listed in Table l. Factor 


Il. Potency, and III. Ac- 


gation, 20 


I (Evaluative) is represented by Items 1, 3, 
5; 6, 7, 8, 9, 10, 13, and 16; Factor II (Po- 
tency), by Items 2, 4, 12, 15, 18, and 20; 
and Factor III (Activity), by Items 11, 14; 
17, and 19. l- 

The 20-item semantic differential was a¢ 
ministered to 66 (28 males and 38 females) 
undergraduate students in elementary psy- 
chology. The 10 Rorschach cards (by sey 
of slides) were projected on a screen ong a 
a time. The Ss were given three mee 
time to check the items on the semantic dif- 
ferential. Previous tryouts indicated that the 
time was quite ample even for the slowest 95$- 
Standard instructions (Osgood et al., 1957) 
were given. Thus, a total of 200 check maie 
(10 stimuli x 20 scales) were obtained fo 
each participant in the experiment. 


Statistical Treatment of Data 


Although each response (check mark) on the 
semantic differential has two essential prope" 
ties—direction and distance—along the polar 
Continuum (or quality and intensity of mean 
ing), our main concern for the pupae o 
this exploratory study was that of aan” 
of meaning. Consequently, all the check % 
from 1 to 7, were dichotomized, thus | 
direction only. The number of checks ar 
Space 4, the midpoint of the continuum, Wa’ 
equally divided between the two gibas 
mized groups of Ss, i.e., those checking Spon 
1-3 and those checking 5-7. By doing pi 
the data were prejudiced to some extent a 
favor of the null hypothesis that there are “7 
differences in the directions of the scale ra 
ings of the Rorschach cards. en 

The significance of the differences beT ne 
the number of Ss checking each direction 5 p 
dichotomized data for each scale) was Srni 
calculated by means of the chi square te 
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“Meaning” of Rorschach 


— Three sets of data were obtained—for 

na sample, for the male group, and for 

a emale group separately. Each set of data 

See 200 chi square values (10 X 20). 

al of 600 chi 7 m 

taineda chi square figures was thus ob 
Results 


on the 200 chi square values for the total 
rye 112 were found to be significant at 
e .05 level to beyond the 001 level. The 
eee ames of the levels of significance for 
Ry scales a : : 
Table 1, nd Rorschach cards appears 1m 
aeons the direction of the 
ferences, Rorschach’s inkblots may be de- 
— by means of the following polar adjec- 
St 


significance of 


distasteful, cruel, 


dirty, 
thick, actives 


Card I: large, strong, ugly, 
cold, 


u 

panh ferocious, heavy, 
e and rugged 

Bio ard Il: good, strong, clean, 
ip hazy, and honest 

Hy re TIT: good, beautiful, clean, tasty, 

nae appy, peaceful, light, clear, thin, hon 

Smooth, fast, and delicate 


kind, pleasant, happy, 
kind, pleas- 
est, active, 


1 * 
th The assistance of James C. Lingoes in processing 
aig data through the Michigan State University 
petal computer (MISTIC) is hereby gratefully ac- 
Nowledged. 


n Chi Square 


Table 1 
) of the 
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Card IV: bad, large, ugly, strong, dirty, distaste- 
ful, worthless, cruel, unpleasant, sad, ferocious, heavy. 
pia a active, rough, and rugged : z 
ard V: small, light, clear, thin. iv 
fast, and delicate Í eae 
Card VI: large 
Card VII: good, beautiful, weak, clean, tasty. 
valuable, kind, happy: pleasant, peaceful, light, dese 
thin, honest, passive, smooth, and delicate , 
Card VIII: good, clean, pleasant, happy, peaceful. 
and hazy i 
Card IX: 
tasty, valuable, 
active, and fast 
Card X: good, beautiful, clean, pleasant, happy 
light, thin, active, fast, and delicate f 


beautiful, strong, clean, 


good, large, 
happy, hot, honest, 


kind, pleasant, 


Tt is interesting to note that not all cards 
show clear-cut agreement in the characteriza- 
tions based on the directions in the polar con- 
tinuum. The meaning of some of the cards, 
such as IV, VIL, II, L and IX, is delineated 
in considerable detail, whereas in some of the 
others, comparatively few significant differ- 
entiations are made. This is particularly noted 
on Card VI where only one significant differ- 
as obtained. A summary of the num- 
ignificant differences for each card, 
breakdown of the findings with 
ale groups separately, ap- 


ence W 
bers of S$ 
including & 
the male and fem 
pears in Table 2. 


Differences in the Incidence of Subjects at 


Level of Significanc: | 
i of Significance Based or a pn 

g s Each Polar End in Judging Rorschach’ s Cards 

greece ae ears 
x K 1 H 

ie vi VIL vill IX x a BA 

ai eon ee se bad 

3 fire = * kaid small 

3. beautiful i iii seek eee PRE ugly seek 

4 wk RA 

. Strong aokoke * +r st we ak a u 

5. clean z er oo dirty mi 

7 sity Epa * * distasteful rt i 

e ý i vorthless oi 

^ valuable è ++ wort! sa 

> ‘ina pH * cruel ore 

Ki > m unpleasant Li 

Dleasan a vs 

os i m t sad 
l1 Mappy * a fit — a 

i i pea 
12 ferocious * se light seek wee ae a 
1, lear ae se X 

Bear aii hazy 
14 ear = J k 

al pe st = ad 

Mi ŝi skk ue S 

oe thin 
17 ' ii dishonest 
1 Wnest p 5 A 

Ts Sette b a asii passive 
qg active ; 7 a 

i e a e smooth 
19 ough 
ae fast tik fee axe 3 slow we z 
E ùi = delicate - 

ged ktk pres i a — : g l 
S pe i 
———— —— 


Aelsnificant 

Ps : at the ,05 lew 

i significant between the „01 
cant beyond the 001 


002 levels pe 
and if confidence: 
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Table 2 
Number of Significant Chi Squares for Each Card for Males, Females, and Combined Sampe 
N Eom m ty Vv Vr vo VO IX X Total 
7 67 
Mal 28 os oe ie F g io 5 å 
SERM 38 11 7 16 17 4 0 12 2 11 6 86 
Combined 66 "u o #16 i7 8 1 17 6 14 10 112 S 
Aao a 
i . of 
It may further be noted, in Table 2, that the group, there are considerable areas 


the number of significant chi square values 
for the individual sex groups is smaller than 
This is readily under- 


ences in the same 
were there signific 
and females in the 
never cancelled eac 
bined in the total sample. 


Differences in the Meanings of the inkblots 
are further noted 


and Activity: 
the opposite (Table 3). 


agreement indicating that the meanings a 
shared by large numbers of people; i.e., t aan 
is a commonality of the meaning reflecte nif 
the group results. This finding is on 
with Richards’ (1958) observation concer! : 
ing the individuality of the Rorschach Sgum 
The possible exception may be Card VI ai 
which there is little agreement (one scale a 
of 20) as to its meaning. To be sure, hare 
considerable Overlapping in the adjectival I 
Scription of some Pairs of cards (such 2 
and VII, IT and VIT); however, in no i 
stance is the resulting profile of any one ‘a 
exactly like any other in the series. Secon y 
the factors into which the scales convoi 
tend to underline further the cini eron c 
the meanings; the Evaluative, Potency, 4 
Activity factors have different directions be 
strengths in the meanings of the several car be 
Thirdly, the meanings of the cards siege 
the same for males and females; no sign aa 
cant sex differences with respect to the rea 
tions to the cards were obtained. to 
These findings must further be relate tig 
the available data and hypotheses concerni 
the Rorschach test. One may address onena 
primarily to two major issues which are the 
terrelated—“how do our findings relate to al 
Symbolic meaning attributed to the seva 
cards by Rorschach workers?” and “what ae 
formation is gleaned concerning the nent i 
of subjects to the color cards?”—an importa’ 
theoretical issue in Rorschach theory. 


Table 3 
Factor Scores for the Ten Rorschach Cards 

Factors I IL HI Iv v VI VII VIII IX as 
RP F F aS, 38 

I (Evaluative) S ano0 Prose mas 98 et nit) Sareea 
HL (Potency) Fete ne igre Da Seas ee 

II (Activity) 28 = 17 A 54 ds E A E A +.76 +. 
A None Ses ee eg Ts. 8) 


“Meaning” of Rorschach 


ee have especially attributed to 
3 ; lots of the Rorschach series particular 
Beene characteristics. Card IV has been 
considered as the “father” card, Card VI— 
oe and Card VII, the “mother” card. The 
ei of these cards has also received 
fe, support from several experimental stud- 
= (Hirschstein & Rabin, 1955; Meer & 
eae 1950; Rosen, 1951). An examination 
= the meaning of these cards via the se- 
mantic differential is, therefore, of particular 
interest, With reference to Card IV, Bochner 


and Halpern (1945) stated: “. - - this card 
embodies something sinister . - - MAY sug- 
Best the father or authority in general.” Al- 

Card 


same authors, 
sexual implications 

. it is generally . . - the most difficult 
Card to interpret,” whereas Card VII is con- 
sidered to have “. . . a feminine quality, fre- 
quently with maternal implications.” 

x we were to examine the adjectival de- 
Scriptions of the cards, presented above and 
based on the semantic differential, we would 
Note some validation of these hypotheses 
used by Rorschach workers and represented 
ne descriptions just quote 
of possibly some of the mas 
as the card are well reflected in 
ant bad, ugly, strong, d 
R ferocious, heavy, t 
ough, and rugged.” The 
nine” quality of Card VII, on the 
S€comes expressed via the opposite polar ad- 
Jectives—“good, beautiful, weak, clean, kind, 
Pleasant, peaceful, thin, passive, smooth, and 
delicate.” It is also interesting to note that 
On 15 of the semantic differential scales, these 
two cards differ significantly and appear at 
the opposite ends of the polar continuum 

he obtained profile of the distribution © 
he adjectives for Card IV is almost a Pet 
i mirror image of that of Card vil. This 


is the most outstanding and clear-cut differ- 
n the series. 


ence þet o cards i 
ween any tw ted the “father” 


but masculinity VS- 


ee according to the 
. is weighted for 


a study by Smith in which 10 sca 
utilized, and the cards were compare 
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the concepts. Smith’s findings did not justify 
the association between the cards and the 
parental figures. The selection of the scales 
may be a determining factor. The detailed 
findings of this study are not yet available 
and, therefore, cannot be related to our re- 
sults. 

Whereas Cards IV and VII are “most 
meaningful” in terms of the semantic differ- 
ential (17 scales—statistically significant for 
each), Card VI seems to be “least meaning- 
ful” for our Ss (only one significant differ- 
ence). It certainly does appear to be “the 
most difficult to interpret.” However, no 
inkling as to the sexual symbolism was ob- 
tained. Maybe the semantic differential scales 
employed do not tap sex-related meaning. At 
ithin the limitations of the instru- 
e stated that this card 
eement as to its mean- 


any rate, W. 
ment used, it must b 
does not elicit any ag" 
ing in our Ss. 

The effects of color in Rorschach’s five 
chromatic cards (II, IU, VIII, IX, and X) 
and the interpretation of the color response 
have been subjects of considerable contro- 
versy as 4 result of divergent findings in a 
number of investigations (Ainsworth, 1954). 
The appearance of color in the Rorschach se- 
ries has been considered as somehow “disturb- 
ing,” “displeasing,” “startling,” and “shock- 
ing.” The “color shock” phenomenon de- 
scribed originally by Rorschach (1944) was 
allegedly present primarily in neurotics. Others 
(Beck, 1946) considered it a much more wide- 
spread phenomenon. Our findings with a “nor- 
mal” student population do not seem to bear 
out the contention that color is disturbing. 
Card II, the first one in the series in which 
color is present, is by and large seen in posi- 
tive terms. The semantic differential yields 
such adjectives as “good, strong, clean, pleas- 
ant, kind, happy, peaceful, and honest.” In 
view of such descriptive adjectives, it can 
hardly be called “disturbing” or unpleasant. 
The remaining color cards (III, VIII, IX, 
and X) reflect even a greater variety of posi- 
tively toned qualities and meanings. These re- 
sults are consonant with Wallen’s (1948) ex- 
perimental findings that “multi-colored cards 
are better liked in the standard form than 
when they are rendered achromatically.” He 
adds, however, that “unstable men show more 
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preference for the achromatic version.” Per- 
haps our sample was made up mostly of stable 
Ss. It may also be argued that the “shock, 

frequently measured by delayed response 
time, could not be detected in our experi- 
mental procedure. But, on the other hand, 
there seems to be no adequate reason why 
our Ss would rationalize their responses or 
“cover up” the meaning of, and their reac- 
tion to, the cards. To our knowledge there 
was no special need for the kind of compli- 
ance which operates when responses to so- 
cially and emotionally conditioned stimuli are 
required. If interpreted parsimoniously, the 
results simply indicate that rather positive 
meanings are attributed to the color cards by 
a random sample of college students who are 
presumably largely nonneurotic. 


raised above 


and im- 
plied in the findings point to the ric 


h oppor- 
he semantic differential 


any other approaches can 


Standing of the Rorschach method. 


Summary 

Sixty-six college students, 28 males and 38 
females, checked 20 items of the semantic 
differential on a seven-point scale for the 10 
Rorschach inkblots, The data were dichoto- 
the Significance of th 


A. I. Rabin 


1. Despite considerable overlap in the mean- 
ing of some pairs of cards, no card was de- 
scribed in exactly the same terms as any other. 

2. There was considerable range in the 
number of adjectives, for which significant 
differences were obtained, which describe any 
one card. Cards IV and VII are most mean- 
ingful, whereas Card VI has practically no 
commonality of meaning. 


3. Cards IV and VII emerged with almost 
perfectly opposite meanings. he 
4. The colored cards were considered by th 


: ios itive 
group as pleasing and in, primarily, positiv! 
terms, 


5. No sex differences in the attribution of 
meaning to the cards were obtained. , f 

The results were discussed in the light © 
existing Rorschach theory concerning car 
symbolism and the effects of color upon Ror 
schach performance. Suggestions for the om 
ther study of the Rorschach by means of t 
semantic differential were made. 


Received July 25, 1958. 


REFERENCES 


s n 

AINsworTH, Mary D. Problems of validation. kz 
B. Klopfer, Mary D. Ainsworth, W. G. agers 
& R. R. Holt (Eds.), Developments in the ‘sky 
schach Technique. Vol. 1. New York: World Bo 
1954. Pp. 405-500. 

Beck, S: J. Rorschach’s Test I: 
sonality pictures, New 
1946, sini? 

Bocuner, Ruri, & Havpern, Frorence. The ¢ ki 
cal application of the Rorschach test. New Yor J 
Grune & Stratton, 1945, Ror- 

HirscustEIN, R., & RaBm, A. I. Reactions to tal 
schach cards IV and VIT as a function of paroni 
availability in childhood. J. consult. Psychol, 1955: 
19, 473-474, er” 

Meer, B, & Sincrr, J. L, A note on the “fath J. 
and “mother” cards in the Rorschach inkblots. 
consult. Psychol., 1950, 14, 482-484. ie 

Oscoon, C. E, The nature and measurement of mea 
ing. Psychol, Bull., 1952, 49, 197-237. H. 

Oscoon, C. E., Sucr, G, J. & TANNENBAUM, P. i. 
The measurement of meaning. Urbana: Univer: 
Illinois Press, 1957, h 

Ricrarps, T. W. Personal significance of Rorschac 
figures. J. proj. Tech., 1958, 22, 97-101. 

RorscHACH, H. Psychodiagnostics, Bern, 
Verlag Hans Huber, 1944, h 

Rosen, E, Symbolic meanings of the Rorschac 
cards: A statistical study. J. clin. Psychol, 19515 
7, 239-244. 

Watten, R. The nature of color 
soc. Psychol, 1948, 43, 346-356. 


A variety of ey 
York: Grune & Strat 


Switz.: 


shock, J, abnorm- 


Dn ”— 


Journal of Consulting Psychology 
Vol. 23, No. 4, 1959 


WHAT DOES THE RORSCHACH Z SCORE 
REFLECT? 


LEON S. OTIS 


Johns Hopkins University 


When Beck (1933) introduced Z, he sought 
a measure which would reflect the individu- 
al’s tendency to organize, relate, and abstract 
aspects of the Rorschach cards into meaning- 
ful units, Because the measurement of ab- 
Stractive and organizing abilities are, presum- 
ably, included in many of the current intelli- 
Bence tests, and because Beck has frequently 
related Z (on an intuitive basis) to high in- 
tellectual ability (Beck: 1933, 1949), many 
tuthors have assumed that Z and intelligence 
test scores ought to be highly correlated. 
e evidence relating Z to intelligence test 
Scores or academic achievement, however, has 
cen inconclusive. Wishner (1948) found a 
“8nificant correlation between Z and the 
€chsler-Bellevue Fullscale and i Subscales, 
negative findings between intelligence 
tests and Z have been reported also (Gold- 
farb, 1945; Jolles, 1947). McCandless (1949) 
ailed to find a significant correlation between 
Academic achievement and Z. 
. e ee oF these contradictory ae 
S difficult to assess, as the subjects of t aa 
Studies varied greatly as to their mental is : 
one study used 42 neurotics as its samp o 
their educational background, their age, an 
eir mental capacity (the sample i pe 
Study consisted of 66 feeble-minded children 
nder 18 years of age). Also, these groups 
fered markedly from the 39 intellecta ly 
Vety superior” individuals used by 5 
(1933) to derive the weights assigned to s 
ifferent Z responses. Beck’s sample ee 
essentially of 32 individuals in the psycho- 
gical, medical, and related fields, 5 ad- 
? Š g r ù > 
Ministrators, a lawyer, and a statistician: Fi- 
Nally, Beck (1949, p- ne) suggested that the 
“organizational activity reflected by Zis 
Only a component of intelligence. Accordingly, 
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the expectation that Z ought to correlate 
highly with intelligence test scores or with 
academic achievement appears to be based on 
an overly restrictive definition of intelligence, 
an unwarranted limitation on the sorts of 
abilities which Z, in fact, does reflect, or both. 

If Z reflects traits other than those tapped 
by the usual general intelligence tests, the 
question is raised: What traits are these and 
how are they to be identified? If groups which 
scored high on Z and which differed markedly 
from the general population in other respects 
could be found, the nature of the correlations 
between Z and the traits which are widely 
shared by the “high Z” group (but not shared 
by the “low Z” group) ought to lead to some 
hypothesis regarding what Z reflects. 

The present study is a step in this direc- 
tion. It compares the Z of a group of execu- 
tives with the Z of lower eschelo 
tional groups. It seems clear th 
differ markedly in broad intellect 
personality traits from other 
Meyer & Pressel, 1954), 
whether the Z of executive: 
nificantly from nonexecutiy 


The sample in this study consisted of 154 
of the 157 records of Beck’s Speigel group. 
Three of the records were not available. The 
records Of 36 executives and junior executives 
(abbreviated, EXEC), 48 skilled workers (sx) 
45 semiskilled workers (s-sk), and 25 un- 
* This study w. 
serving a clinic; 
nois, 


n occupa- 
at executives 
ual and other 
employees (see 
This study asks 


s also differs sig- 
es. 


hile the author was 
at the University of Mi- 


» Division of Psychiatry, 


inois, for 
valuable suggesti 
grateful to S, J. Beck and S 
cooperation in making the ck’ i 
Population available for study, sie 
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Table 1 


Chi Square Comparisons of the Differences in Z Scores 
Between Executives and Nonexecutives 


At or 
Below Above a 
Mdn Mdn x 
a 13 23 
a 09 19 4.86 03 
x 13 23 g 2 
ae 28 17 5.46 0: 
13 23 
EXEC 7.60 -008 
SK 18 7 
UN-SK 
23 25 © 
ae 23 22 <1.00 N.S. 
24 24 : 
SRA 13 12 <1.00 N.S. 
pene 22 23 
oe B 12 <1.00 NS. 


skilled workers (UN-sk), 
Membership to these groups 
the protocols, 

Table 1 shows that Z dist 
EXEC group from the 


were examined. 
was indicated on 


inguished the 


other groups but did 
not distinguish between the “nonexecutive” 


groups. The median scores of the four groups 
were 27.0 for the ExEC group, 17.0 for the sk 
group, 16.0 for the S-SK, and 15.0 for the un- 
SK, groups, 
The wide disparity between the Z scores of 
the ExEc group and the scores of the other 
three groups is noteworthy. If this finding can 
be taken at face value, it suggests that Z re- 
flects at least some of the characteristics which 


lead to the top level of the managerial hier- 
archy. 


Leon S. Otis 


Of particular interest here, however, is ea 
fact that Z, a score which was derived on t : 
basis of examining the Rorschach records $ 
a group of scholars and professional peop ‘ 
was successful in distinguishing eas 
from other employees. Although differing i 
many respects (in terms of values, life ee 
goals, etc.) from each other, scholars oa 
executives obviously share some importa J 
traits or characteristics in common. These H 
pear to be reflected in Z responses. Peris 
Z reflects a rather global trait which mg k 
be called “giftedness”; or perhaps Z rene 
ambition, or intellectual curiosity, or BE E 
These are some of the traits which scho a 
and executives might be expected to she 
This sort of guesswork is completely unsa a 
factory, however. What is needed is a iac 
analytic study of scholars, executives, Si, 
nonscholars and nonexecutives with the Ri 


; jons 
schach Z score as one of several dimens 
of comparison. 
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BRIEF REPORTS 


BERNARD L. BLOOM °? 
Territorial Hospital, Kaneohe, Hawaii 


__ The present study was designed to examine the 
Mpact of ecologic factors on the responses to 
One Wechsler subtest in a situation where ed 
nounced differences were expected and where A 
Tectional hypotheses could be advanced. See 
“ally, the Picture Completion subtest (PC) $ 
© Wechsler Adult Intelligence Scale (W ATS) 
Was administered to 67 second- and third-year 
üdent nurses in St, Louis, Missouri, and an 
equal number of student nurses in Hawaii, nor? 
of whom had ever been to the mainland. Si Vo- 
ition, all subjects were given the WAIS ss 
Sabulary subtest in group form in order to asse: 
© level of linguistic skill. “ea 
1 he filiowing hypotheses were tested: 1. nl 
and student nurses will perform higher ) 
awaii student nurses on PC Items 11 EA 
dog tracks), 13 (Florida), and 20 (Snow); 
* Hawaii student nurses will score inh ad 
Stter than student nurses on the mainland OY 
st ems 8 (peg), 9 (oar lock), 14 (smo 
àcks), and 15 (crab’s leg). š i 
ath. Soiree S student nurses obtained higher 


this study may be ob- 


i Bernard L. Bloom, ga 
weal Hospital, Kaneohe, Hawaii, or for a en an 
merican Documentation Institute. Or ate a 

3 No. 5894, remitting $1.75 for micro’ 

: i Hest : ents, 

: © autor oaks to express his ere e 

N. Mensh and his assistants Judite Era 

ranq and Eileen J. Turken, formerly of tl re D 
“nt of Medical Psychology, Washington “Catal 

hoot of Medicine, who so kindly provide: 

Nt nurse data for the mainland group. 


1 
tat An extended report of 
ed without charge from 


Ivan 


~r 
uw 


res and had less variability on the PC 
ol ences subtests than the standardization 
sample of equivalent age. The mainland group 
obtained higher scores than the Hawaii group on 
both subtests with the difference being at the oe 
level on Vocabulary and at between the 05 an 
10 levels on PC. The order of presentation on 
the WAIS test is somewhat more appropriate for 
the mainland group than for the Hawaii group. 
The subtest scores correlate .22 with each other 
in the mainland group and .00 in the Hawaii 
EA of the four items hypothesized to be easier 
for the Hawaii student nurse group appear to be 
somewhat easier for this group, and the differ- 
ence on PC Item 15 (crab’s leg) achieves signifi- 
cance at the .02 level. Of the four items hy- 
pothesized to be easier for the mainland group, 
three are easier for this group and the differences 
on PC Items 12 (dog tracks), and 13 (Florida) 
are significant at the .01 level. PC Item 11 (stars) 
is insignificantly easier for the Hawaii group. 
Thus, of the eight items for which directional 
differences were predicted, only one comparison 
failed to lie in this predicted direction. 

In addition to suggesting that the PC subtest 
may be less suitable for use in Hawaii than on 
the mainland, these results tend to show that 
specific characteristics of a subject's environment 
should be taken into account when evaluating 
test results and that ecolo 


a gic characteristics m: 
have a predictable and de ip 


c monstrable relationshi 
to psychological test performance. d 
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PERSONALITY IMPLICATIONS OF CIGARETTE SMOKING 
AMONG COLLEGE STUDENTS 22 


DANIEL S. P. SCHUBERT 
University of Chicago 


Freud considered smoking an adult extension of 
autoerotic sucking in childhood, and Fenichel re- 
lates oral fixation to the manic-depressive cycle. 
The hypothesis is suggested that manic-depressive 
tendencies vary directly with amount of smoking. 
Vallance’s findings (1940) that smokers are less 
suggestible indicates the second hypothesis that 
hysteria varies inversely with amount of smoking, 
Lynn’s (1948) conclusion that nonsmokers have 
better “disciplinary records” at secondary school 
suggests the additional hypothesis that psycho- 
pathic-deviate tendencies vary directly with smok- 
ing. 

The group form of the 
Personality Inventory was 
lege group during freshma 


men and 134 women 
7 An extended report of this 

tained without charge from D 

Department of 

Chicago 37, M. 


2 Paper read at the mecting of the American Psy- 
chological Association, Washington, D. C., 1958, 

3 The author is indebted to Desmond Cartwright 
and Loren Chapman of the University of Chicago 
for their helpful criticism and Suggestions, 


were asked if they smoked cigarettes. or meih 
47 men and 51 women did. This eager a 
smokers is also representative of the “u S. 
northeastern population for this age ae 
Department of Commerce, Bureau of 

ik results were in the predicted direction o3 
the Ma, Pd, and Hy scales for both sexes Fol 
for the females on the D scale. The rana cte 
males on the D scale were not in the pea i 
direction. Two-tailed ¢ tests showed the oF e 
cance on the Ma and Pd scales to be beyon be- 
-001 level for the men and on the Ma scale 
yond the .01 level for the women. The digere rhe 
on the Hy and D scales were not significant. for 
difference on the Pd scale was not significan cale 
the women. Similar ¢ tests on other MMPI ‘det 
means were not significant, There was cone , 
able overlap of smokers’ scores and nonsmo! 
Scores on all scales of this study. 

Brief Report, 
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7 “ANXIETY” VARIABLES 
ğ IAL DESIRABILITY” AND “AN 
= IN THE IPAT ANXIETY SCALE'! 


A. W. BENDIG 


University of 


Bendig and Hountras (1959) have suggested 
that Cattell’s division of the items in the fan! 
Anxiety Scale (Cattell, 1957) into “covert” an 
“overt”? subscales was similar to the “subtle and 
“obvious” items in the MMPI and that Cattell’s 
“covert” anxiety items should show a lower cor- 
relation with Edwards’ Social Desirability Seale 
(Edwards, 1957) than would the “overt” anxiety 
items, One difficulty in testing this hypothesis is 
that 22 of the 39 items on Edwards _SDS ue 
also scored for Taylor’s Manifest Anxiety = 

Edwards, 1957, p. 32) and could be presume 


0 be more highly loaded with an “anxiety” oe 
ie than are the remaining 17 items. In the fol- 
OWin 


E research, these two subsets of SDS items 
ste Separately correlated with scores from Cat- 
Lell’s scale, eed 
he 40-item Cattell and 39-item Edwards’ SDS 
Scales were administered to 238 Ss (110 men and 
Women) enrolled in educational cere’ 

cal courses, Seven scores were obtained for eac 
` Covert Anxiety (CA), Overt Anxiety (OA), 
ference Score (DS) (CA minus OA), and To- 
tal Anxiety (TA) (CA plus OA) from Cattell’s 
tale, and SD-MAS, SD-NonMAS, and SD-To- 
a (SD-MAS plus SD-NonMAS) from Edwards 
scale, Correlations among the seven scores nae 
“rately computed within each sex group ar 
i n averaged, since the men were significantly 
Ower on OA, TA, SD-MAS, and SD-Total. ; 
The correlation between CA and ap eat 

Z6) was significantly lower than the OA a 


` An extended report of this study may be ob- 
tained without cites from A. W. Bendig, Dept. Ey 
P, Ychology, University of Pittsburgh, Pittsburgh 13, 

Or for a fee from the American Documentation 
"stitute, Order Document No. 5919, remitting $1.25 
s Microfilm or $1.25 for photocopies. 


Pittsburgh 


SD-Total correlation (—.70), OA was more highly 
related to SD-MAS (—.76) than it was to SD- 
NonMAS (—.48), while CA scores showed simi- 
lar correlations (—.53 and —.47) with both sub- 
sets of SDS items. The TA score correlated higher 
with SD-MAS (—.71) than it did with SD-Non- 
MAS (—.52). DS correlated significantly with 
SD-MAS (.36) and with SD-Total (.29), but not 
with SD-NonMAS (.10). The correlation between 
CA and OA was .58 and between SD-MAS and 
SD-NonMAS was .59. 

The hypothesized higher correlation of OA and 
SD-Total was confirmed, but is attributable to a 
higher correlation of OA with the SD-MAS items. 
All of the scores, with the exception of DS, seem 
to measure a general “social desirability” vari- 
able which accounts for most of the relationships 
among the scores. However, OA and SD-MAS 
appear also to have another variable in common: 
presumably an “anxiety” component. CA appar- 
ently is not a useful measure of “anxiety” ex- 
cept insofar as it operates within the DS score 
as a suppressor variable for “social desirability.” 


Brief Report. 
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SEX DIFFERENCES IN BODY CONCEPTS! 


GEORGE CALDEN 
Veterans Administration Hospital, Madison, Wisconsin 


RICHARD M. LUNDY 


Universit y 


There is little doubt about the i 
bodily and facial attractiveness in 


reme forms of end 
mesomorphy, and ectomorp) 

The results indicate that males 
pounds heavi 


omorphy, 


chology Service, Veterans 
Madison, Wisconsin, 


AND RICHARD J. SCHLAFER 
of Wisconsin 


dis- 

wished to be taller, whereas one half of be. 
satisfied females wished to be shorter. iveness 
express less satisfaction with the attractl shoul- 
of their bodies, Males wish to have wider refer 
ders, thicker arms and legs; females p an 
smaller hips and waists and thinner Ana 
legs. Almost half of the females desire chests: 
busts and half of the males desired bigger facial 

Females also are less satisfied with their sing’ 
features than are males. Ss of both eae wis! 
Out the nose as the facial feature they mos how- 
to have altered, usually made smaller. Me ani 
ever, wished to have more prominent chins get 
ess Prominent ears; ‘females Brokers shape: 
“yes, better vision, and a more oval facia omato- 

Ss of both Sexes regard the balanced nE 
type figure as most attractive and the $ ma 
endomorph as least attractive of the aire for- 
body types, Females, however, viewed a type 
mer as more attractive and the latter boc? nales 
A3 more repulsive than did the males. meso- 
also were less inclined to view the extreme ©" of 
morph (the “muscle man”) as ariraciivo ai i 
the above differences were significant at X 
level, the 

In general, females desire changes 4 petite: 
waist down and wish for smallness an Jes ate 
ness of body parts (except for bust). Ma waist 
dissatisfied with body dimensions from tne ale 
up, desiring bigness of body parts. The P ephic 
dislike among females for extreme endom pat 
and me€somorphic male physiques may pe ae 
a projection of their Personal wish for de 
hess in their own bodies. 
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Brief Reports 


The Journal of Consulting Psychology will 
accept Brief Reports of research studies in 
clinical psychology for early publication with- 
out expense to the author. The procedure is 
intended to permit the publication of soundly 
designed studies of specialized interest or lim- 
ited importance which cannot now be ac- 
cepted because of lack of space. Several pages 
in each issue will be devoted to Brief Reports, 
published in the order of their receipt with- 
out respect to the dates of receipt of the regu- 
lar articles. Most Brief Reports appear in the 


first or second issue to go to press following 
their final acceptance. 


An author who wishes to submit a Brief 
Report: 

1. Sends the Brief Re 
page and pre 
given below, 


2. Also sends to the Editor a full report of the re- 
search study, in sufficient detail to give a clear ac- 
count of its background, procedure, results, and con- 
clusions, which will be filed with the American 
Documentation Institute to insure indefinite avail- 
ability, 

3. Prepares at least 100 mimeographed copies of 
the full report, which the author will send without 


charge to it as long as the supply 
lasts, 


port, limited to one printed 
pared according to the specifications 


all who request 


4. Agrees not to submit 


the full report to another 
journal of general circulati 


on, 


Specifications 


Brief Report will be no 
longer than one printed Page, its typescript, 


including all matter except the title and w 
author’s lines, must not exceed 85 lines at 
eraging 42 characters and spaces in leng af 
Set the typewriter margins for short lines 5 
42 characters, which are 3.5 inches long 
elite typing, and 4.2 inches long in pica. a 

he manuscript of the Brief Report m 
be double spaced throughout. Except for Ei 
short lines, it follows the standard style a 
Hams eision of the APA Publication 
Manual. Headings, tables, and zekeren 
avoided or, if essential, must be counte aa 
the 85 lines. Each Brief Report must P a 
companied by a footnote in the style be 5 at 
which is typed on a separate sheet and 
counted in the 85-line quota: 


1An extende 


ob- 
d report of this study may be 
tained without 


et 
charge from John Doe, 300 a 
St., Prospect 6, Mass. (giving the author's ful Docu- 
and address), or for a fee from the American re- 
mentation Institute. Order Document No. —— 


ent hoto- 
mitting for microfilm or $—— for P 
copies, 


Extended report. Because the extended 1% 
port is intended for photoduplication, rE 
not copy to be sent to a printer, its A i 
should differ in several ways from tha aa 
other manuscripts: (a) The extended a 
should be typed with single ages ig 
economy in duplication. (b) Tables an Et 
ures should be placed adjacent to the Pa 
which refers to them. A caption should uld 
typed below each figure. (c) Footnotes ge 
be typed at the bottom of the page on W. etal 
reference is made to them. In other respe ci 
the full report is prepared in the style spe 
fied by the Publication Manual. 
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ISTS’ 
YCHOTHERAP 
CTORS IN PS a 

a SERCE TIGN OF THEIR PATIEN 


NORMAN I. H ARWAY 


e n ntistr. niversity 0, ochester 
l Medicine and Dentistry, Universi ÍR 
School of Q 


s 5 mond (1953), 
Pree z Fiske, 1951). Dymon 
. ing the course of 1951; Eny ie method as a measure 
The psychotherapist, pung, ins a degree who used Pr shown that counselors’ pre- 
een za Md oe re understand- of empati client responses are not primarily 
<< Knowledge of his patient. ith regard to dictions O f the counselors’ stereotype of the 
ing that the therapist develops wi l a matter a funckiana 
p Patient is not, however, merely a thin average client. — ments regarding the 
of extent or quantity of information. B and in The mtn ayo ales. eh Amang 
R . a . e vi 
ihe internal experience of the ha us evident patient er ces be posited are the patient 
hat pressions of his kookan adhere to those walc timulus, some general attribute 
hat different degrees of certainty nist knows himself as a f the therapist as a perceiver or 
© varying things that the = about the or capacity i r people, the personal qualities 
raout his patient. Some SE ccitation or Enower gto: iit is reflected in his conflicts, 
Patient are offered with little ett d tenta- of the Se aes and needs, and the theo- 
fect: Whereas others are form alifications. desires; ae which the therapist utilizes in 
Yoly and expressed with mS the ade- T E thinking about the patient. 
i 7) o a 
here has been much discussio discussions Observing a complex structure which relates 
iy of Clinical Judgment. bee with T oe understanding, empathy, 
Or the most part have been lead to to the 4 A 
wi ae inical methods lea eactions to the patient. 
hether statistical or clinica redictions of and r eat study B an: attempt toeroe 
paeteater number of accurate P Ability to ge ie f this structure. The questions 
patient behavior (Meehl, castes how- S es SOA (a) Is the therapist aware 
"edict is but one criterion of k es not investiga : A 
Ever, Awareness of what one does oF ao a re- of what he knows and does not know about 
OW regarding a person would also A con- the patient? In terms of the operations here 
ardin: ; F Sele 
ection > Ein ae dge as would interna one’s involved we may phrase the question: Is the 
Sistency in the statements expressing therapist’s confidence in his predictions of a 
i lity question- 
er, i erson. ve patient’s responses to a persona ) 
Aing T in recent years aN naire related to the accuracy of these predic- 
een E A with the ability of te in- tions? (b) Is there any relation between the 
Vidual to predict the behavior of E erapy, therapist’s knowledge of specific behaviors of 
vidual. In connection with psyc therapist's his patient and his description of the patient 
Kelly and Fiske (1951) used vad response in more abstract terms? This may be ex- 
ability to accurately predict Pye competence. amined by a comparison of a personality 
One measure of Sas ae the similarity profile derived from individual item predic- 
€ therapist’s estimation atient, or of the tions with a profile constructed in terms of 
between himself and PoPa deal” and the therapist’s more global perceptions of the 
Similarity between the t tions, has also been patient, (c) Does the therapist’s orientation 
the patient's selt-dese P enpetence (Fiedler, relate to the prediction he makes for the pa- 
u; tin i et. = pia. aed i 
88ested as relating sspparted i part by a Hent In part, the therapist’s orientation or 
This investigation was $ Pund for Research in Viewpoint is reflected in the particular goals 
j Brant from the Foundations and in the relative im- 
SYchiatry, 


he sets for a patient 
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portance he assigns these goals. It is this 
somewhat specific feature of the therapist’s 
frame of reference that is tapped in the pres- 
ent instance. (d) To what extent do the 
therapist’s own characteristics influence his 
perception of the patient and the goals that 
he sets for the patient? 

While the problem falls under the general 
rubric of interpersonal perception, the psy- 
chotherapeutic setting was chosen because of 
the intensity of the relationship that de- 
velops and the role assignments in which it 
is the duty of one person—the therapist—to 
know, to understand, to empathize with the 
other. The therapeutic procedure is designed 


in many ways to maximize knowledge of the 
patient. 


Procedure 


Nine psychotherapists participated in the 
present study. The attempt was to obtain a 
reasonably homogeneous therapist group. In 
the current instance the nine were either 
senior psychiatric residents or junior staff 
members in Psychiatry, all of whom had from 
two to four years? training in psychiatry at 
the same institution, W 
was in many ways ecle 
of reference might best 
choanalytically oriente 
the study, 
patient de 
none were 


, deference, order 
tonomy, affiliation, i 


dominance, abasem 


time and to the patien 
the personality inventory. I am indebte: 
ticipants in the Research Conference o; 
ment of Psychiatry for their counsel, 


ts who participa 


Norman I. Harway 


endurance, heterosexuality, aggression. T 
test is designed to minimize the influence r 
social desirability as a response determi 
Statements representative of each need we 
are paired twice with each of the other iste 
fest needs. For each item (pair of ae 
ments) the subject (S) records which of hat 
two statements is more characteristic of yest 
he likes or how he feels, A measure of oy 
consistency and a measure of profile stala 
can be obtained as well as the primary ™ 
scores. 

Each of the nine therapists filled out E 
EPPS with the usual instructions, ihat mina 
he felt the various items were applicable in- 
himself. Shortly after this, the writer mea 
dividually with each therapist and it 
with him the patients under his care. m om 
an attempt was made to select a patienti i 
the caseload of each therapist who bem 5 a5 
homogeneous with respect to such variab e 
age, sex, diagnosis, length of treatment, cted 
type of treatment with the patients oo 
for the other therapists, only limited suc o 
was achieved. The essential characteristics e 
the patients are presented in Table 1. fe- 
age range is 17 to 35; six are male, yas ar- 
male. All patients had been seen by their P“ 
ticular therapist for at least 20 hours. Japse 

At least six weeks were permitted to € nge 
before the second step in the study. Awe pr 
ments were made with each therapist an ap. 
tient so that at the end of a specified ther sy- 
hour the patient immediately went to the Pie 
chology offices where the EPPS was adm 


$- - r fice: 
tered. At the same time, back in his 0 


EPPS 
the therapist attempted to answer the EP. 


> +43 Ad- 
as he thought the patient was doing T As 
ditional tasks were set for the herah the 
he responded to each item as he thoug 


een 
° Other writers have made the distinction pe her 
prediction, where one states in advance what aed a 
person will do, and postdiction, where one sayy now! 
the other individual has already done though ithbeld- 
edge of the other’s performance has been wiiction 
In this study, then, we are dealing with co ing 
The term codiction will be used when retest ya 
our procedure to emphasize that the merana 5 
aware of both the setting in which the patien tient- 
responding and the immediate mood of the pa class 
When referring to the work of others or to he an? 
of procedures relating to one Person saying wha the 
other has done, is doing, or wil] do, I will use 
more usual term—pfrediction, 


eee 
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Psychotherapists’ Perception of Their Patients 


Table 1 


Description of Patient 


Interviews 
with Diagnosis 
s ione Therapist 
i 9 Education ee 
-a 2 = E Character trait disturbance . i 
1 M 21 15 2 Adjustment reaction gi aalen 
2 M 19 9 65 Character trait aisn ani” 
M 25 18 37 Obsessive-compulsive gee ad 
d M 17 - 75 Schizophrenic Ee nent eaw 
5 M 22 12 Ms Adjustment reaction of ac $ = 
6 M 23 16 100 Hysterical character disorde 
i F 33 12 30 Conversion reaction eee 
g F 35 14 121 Adjustment reaction ot a 
9 F 20 15 


~ Number of years of formal schooling. 


Patient was responding, he was asked | mei 
Cate on a five-point scale the degree © the 
idence that he had that his statement for re- 
Particular item would match the pain ae 
Ponse to that item. When he complet 1 had 
task the therapist took a sheet wiih the 
listeq on it the 15 need areas for which s 
is scored. Each area was defined en 
the EPPS manual. The therapist SS. oats 
the 15 areas in terms of his opinion P er As- 
Sminance for the patient at that i SA 
paing the validity of the EPPS the DGA 
Pist Was, in essence, making en psy 
tam of the patient’s personality. a- 
After a janke of at least six weeks pia 
Dist was again given the EPPS; this ti oo BE 
© instruction to complete the _ lete it 
Would Tike to have his patient compete i 
at the end of the therapeutic pie a five- 
Same time, the therapist ee him that 
Point scale how important it was to complete 
the end of treatment his patient 
each item in this particular way. 15 need 
To recapitulate, for each of a on: (a) 
areas we have seven scores base Pte, (b) 
Patient's performance on parm (c) 
€rapist’s performance ee im, 
Crapist’s codiction of Avenue for the ac- 
) therapist’s confidence near tal rank or- 
curacy of each of ie cies mg f) therapist’s 
Statement of hat he mould eventually want 
Patient to betke (g) inpotan ra hs z y 
erapist for each item as he does the im- 
mediately preceding task. 


Results 


J treated each patient-therapist pair 
aa day onite a separate experiment. 
Thus, the nine pairs can be taken as nine 
replications of the same experiment. This en 
ables each pair to act as its own control. Our 
concern, then, is to compare for each thera- 
pist those areas for which he shows maximum 
knowledge with those for which he shows less 
knowledge. We have then combined the re- 
sults of these nine replications on the assump- 
tion that these might be considered aS suc- 
cessive samples from a population of similarly 
qualified therapists. The nine therapists rep- 
resent nine-tenths of the population of thera- 
pists meeting the description given above who 
were available to us locally. 

The normative sample on which the EPPS 
was standardized consisted of college men and 
women between the ages of 15 to 59, with the 
majority being at the lower end of the age 
range. To test the adequacy of the test for 
our sample, the measures of test consistency 
and profile stability were computed. Test con- 


sistency is measured by repeating 15 items 
in the inventory; 


the score is the number of 
items answered in identical fashion on both 
occasions. Profile stability is evaluated by 
correlating the sum of half the items con- 
tributing to a need score with the sum of the 
alternate half. The correlation is across the 15 
personality variables for a single S. The data 
are presented in Table 2. Edwards (1954) 
Suggests that if an S obtains a consistenc 
Score of less than nine the validity of that 
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Particular test may be questioned (p. 7). 
Neither the patients nor the therapists, re- 
gardless of the instruction set used, show a 
lack of consistency by this standard. Further, 
the profile stability coefficients compare fa- 
vorably with those reported in the test 
manual. The median correlation reported 
there is approximately .71. It seems proper 
then to use this test with a patient popula- 
tion. It is also reasonable to conclude that 
the various instructional sets did not invali- 
date the use of the questionnaire. 

Assuming the equal likelihood of a positive 
or a negative relationship between the vari- 
ables in which we are interested, we find that 
by the binomial method we would expect all 
nine replications to come out in the same di- 
rection twice in a thousand times and eight 
out of nine to fall in the same direction two 
times in one hundred. However, as we set 
forth no directional hypotheses, a two-tailed 
test seemed appropriate and the respective 
values would then be 004 and .04, Eight out 
of nine in the same direction with a $ value 


of .04 is taken as constituting a statistically 
significant finding. 


The therapist’ 
when he attempt 


Correlations, on 
pair, are present 
will be noted th 
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tions are positive, one falling at the .03 pio 
ability level. If we compare the rank 0 ist. 
Psychogram as drawn up by the ae 
with the relative ordering of the areas nm); 
rived from the patient’s responses (Colum ta 
we find that all nine correlations Sugee MA 
positive relationship. The negative sign 1N re- 
instance results from a rank of one r 
senting the most dominant area and a Aan 
of 15 representing the least dominant related 
the therapist’s ranking. These were corre reas 
with the actual scores for the 15 need hig 
based on the patient’s responses where a f an 
Score represents the relative dominance co 
area. Here, again, one of the individua Tt is 
relations is significant at the .02 level. ts 0 
Possible, however, that one of these E is 
correlations is a statistical artifact. The 

a high degree of relationship between the 
therapists’ codictions at the two levele 
sum-of-items score and the more global i a 
ordering. Table 3, Column 3, shows tna 
nine coefficients imply a positive relat Ca e- 
and all are significant at the .02 level welateS 
yond. If one of these two levels corte acl 
with the patient’s Psychogram, then the sta- 
that the other does so also is a matter 0 0s" 
tistics rather than psychology. It is not R f 
sible to extract from these data which m 2, 
the three sets of correlations (Columns ally 
3) are independent, Are the therapists ed fore 
good codictors at both levels and me 

the two levels turn out to be correlate an 
does the relationship between codiction 


Table 2 
Test Consistency and Profile Stability Measures 
Patient Therapist Codiction Goals 
Consist- Consist- Consist- Consist- jlity 
Patient ency Stability ency Stability ency Stability ency Stab 
1 12 96 12 82 13 87 13 a 
2 11 73 14 92 11 93 12 ‘30 
3 15 84 10 '89 13 88 11 ‘97 
4 13 74 14 91 14 93 15 ‘92 
5 14 88 13 1 12 84 u ‘84 
6 9 92 14 78 12 82 12 ‘g4 
7 10 95 13 83 14 84 on 70 
8 10 92 11 62 12 7 13 “39 
9 13 93 11 84 14 94 u i 
4 
Median 92 84 87 $ 


i. ion of Their Patients 
Psychotherapists’ Perception of 
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Table 3 
Intercorrelations 
(N = 15) ; 
Fea ae 4 5 6 ; 
1 2a et ee Accuracy- Accuracy- : 
“odiction- Patient- ae cece =. 
: otic ee foul Ode Therapist Therapis 2 
tient Codiction Rank Order Ra 2 3 
E D 78* 49 a A B 
1 38 —.35 “ez 2 $ i E 
2 37 —.04 =, Pas 1 8 2 
3 23 ” = = .12 f: n E 
4 36 —.06 ae 24 = 10 4 
5 .28 —.27 ee 63* 30 30 -45 
' 38 ZA Toi ‘00 20 3 25 
7 38 —.31 a 00 A 28 09 
w Ei Zire —.01 , 
Y 00 —.16 -. 


r= jationship. 
+ Negative correlation signifies positive relat 
b S05, 


Patient response exist at only one ee 
Since the therapists are consistent at, nship 
nt levels there is also a positive relatio 
at the Second level? g- 
e size of the correlations, hower"e a 
Ksts that the individual therapists fis are 
highly efficient predictors. Our resu reports 
comparable to Dymond’s (1953); a with a 
relations ranging from .05 to di tions of 
edian of .41 for counselor predic tment. 
dient responses at the end of ne .00 
‘umn 1, Table 3, shows a range zing our 
055, with a median of .36. ames item- 
Mata by the more usual procedure © basis and 
“item rather than need-area score ould lead 
“ssuming that a random a sane digte a 
O half the items being accurate The thera- 
._ Nd that in all nine instances ate codic- 
bist haq more accurate than ee eae are 
l NS, seven of the nine chi smagi the com- 
vBNificant beyond the .05 level, ees of free- 
aged chi square with nine degr 
m has a p<.00l. hich may lead to 
© analyze another triad wht of codiction: 
“Purious evaluation of penn Tee ts between 
te is no consistent ne ’s needs and 
€ relative strength of patie 
thos 


Column 4) 
€ of the therapist Gane a 


z; ip between 
"is there a consistent relations? for the 
i) relative aR PEE strength 
Eran; P 4 5 
th ee Sheen for the patient (Col 
i 
Umn 5). 


To test whether the therapist knew what he 
knew, the confidence he expressed in his i 
dictions for a need area was compared sn 
his accuracy in codicting for that E E ; 
patient’s personality. Correlating the ae he 
the confidence ratings for each area with the 
number of accurately codicted items in that 

we find that eight of the nine correla- 
fons are positive, one being significant beyond 
the .01 level (Table 3, Column 6). It seems 
likely, then, that the therapist’s sense of cer- 
tainty or doubt is related to his actual knowl- 
edge. Here, again, the individual correlations 
are not very high. However, comparing mean 
confidence rating of accurately codicted items 
with the mean confidence rating of the inac- 
curate items, the mean rating of the former 
is greater for all nine therapists, four of the 
nine ¢ tests are significant at the .05 level or 
better, and the combined probability of the 
nine £ tests is less than .001. The fact of 
greater or lesser consistency between the two 
levels of prediction by the therapist for a 
given area did not seem to relate to the ac- 
curacy in Predicting for that area of the pa- 
tient’s Personality (Column cue 


The final task set for the therapist was to 
indicate how he would li 


ke the patient to an- 
swer the statements on the EPPS at the com- 
pletion of treatment and how important he 
felt it to be that the patient answer the par- 
ticular response in the 


particular way. If we 
compare the scores for each need as derived 
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from this response set with the importance as- 
signed to the items in the various need areas 
(Table 4, Column 1), eight of the nine cor- 
relations are positive, three being significant 
beyond the .03 level. It would seem, then, that 
those areas in which the therapist would like 
his patient to score high are the areas which 
are most important for the therapist. Neither 
the goal scores nor the importance ratings 
show a consistent pattern over the nine thera- 
pists with the codictions (Columns 2 and 4) 
nor with the rank ordering of the areas by 
the therapist (Columns 3 and 5). In other 


n responses to the 


an area for the therapist did not relate to his 
ea (Column 7), 
Discussion 


It has been 
tion may be a 
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ee 


ity of the various subscales is controlled, was 
chosen to eliminate the likelihood of a E 
eral desirability or social acceptability set des 
termining codictions. In certain instances pre- 
dictive accuracy may be enhanced by Pea 
jection.” In terms of the operations inyo k 
if the predictor projects—that is, answers aA 
the predictee as for himself—then he may he 
accurate not through any knowledge of t 2 
patient but because the predictee “acaden 
tally” happens to be like himself, In the i 
ent data there is no significant relations ah 
between the need patterns of patient a 
therapist nor between the therapist’s own pê 
tern and the one he codicts for the patien g 
In requiring a therapist to make a set nu in 
ber of predictions about his patient to ae 
an over-all measure of the therapist’s un ily 
Standing, the assumption is made that en ge” 
relevant information is available to all P 
dictors and that equally relevant informat E 
is available regarding the various predi 
to be made, The knowingness of the oe 
pists, however, resides as much in their ae 
ness of their relative understanding of T elr 
ent aspects of their patients as well as in t on 
ability to codict what their patient will dp or- 
a personality questionnaire. The positive “le 
relation between the item codiction Pr? ji 
and the rank order profile suggests an ep- 
ternal consistency to the therapist’s conc e- 
tualization of the patient. The consistency P® 


. . A 
desirabil- tween the formulations at the two levels 
Table 4 
Intercorrelations 
s : (N = 15) A 
— a — — 
1 
2 g 3a 4 5a 6 7 
Goals- Goals- Go; I Í I a 
A als als- Importance- Im ortance- Goals- Impor 
Patient Importance Codiction Rank Order Codiction Rank Order Therapist Accuracy 
5 a ait 42 =g 7 42 31 
3 47 a 05 26 12 56" 00 
4 =06 a 45 29 ~ 23 30 a 
5 '56* ~ Se = 40 = 36 73" 2 
E =5 52* = 17 = 
° ol 39 =23 .22 — 2 47 =n 
: ar —.10 08 Sty «23 20 A 
: 12 31 a1 36 —27 31 46 
9 87 ~.27 Sat ~38 08" 25 =a 
: Negative correlation signifies positive relationship, 
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not related, however, to the accuracy of co- 
diction at either level. ing 
The therapist’s knowledge or unieran an 
of his patient has been treated here as a ‘h se 
able rather than as a constant process. T pe 
Studies utilizing predictive accuracy or ae 
sumed similarity (the similarity er his 
therapist’s predictions for the patient “a of 
Wn responses to the task) tage or 
therapeutic competence, empathic abi 5 ling 
à general tendency to have a warmer ‘tae 
and liking for one’s patient focus on sses 
Measures as indices of constant pose ii 
within the therapist, that is, as Gue 
marily a general attribute or capacity x tion 
therapist (Cronbach, 1955). Our ee a 
aS been that understanding is not a i 
Unction of the patient (that is the s i T 
object) as well as of the be aig but 
Setting in which he knows thie pastes sct to 
that Understanding is variable with oa In 
different aspects of the stimulus obje pared 
© Present instance, then, we hag Set 
di erent indicators of the therapis a and 
8e with respect to one peimuias a! i under- 
ave investigated the relationship © f refer- 
t ing to the viewpoint or frame o 
of the therapist. a int, 
ough we kiawe used the terms Y ae 
‘Tame of reference, and orientation shenvaniod 
p terchangeably, the thing we are E oes 
M is the theory which the thierapis! he jor 
wt approach here has been ang investi- 
\ttedly too limited. The problem. 0 of the 
Sating the higher order ateersetion® atcect 
Clinician in a manner which will ena femenis 
Parison with more concrete sta ight & 
S been a stumbling block Le art the 
“tench, 1939). The consistency ae a 
therapists? formulations at the two id some 
tained in the present study eters 
a on this matter. Unfortunately, } though 
SYstem on which the EPPS is based, eng 48 
Closely related to psychoanalytic — aí 
Not identical with the frame of oars 
therapists, and many of our t con- 
Probably had not yet achieved a clear, ane 
e tent, conscious theoretical pO of alte 
in dings are also limited by the level of tra 
8 of the therapists. > 
e dereie that exist between an ay. 
“es based on summing the individual item 
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into need scores and ae SS 
a n 
aoa aa between confidence 
sponse a accuracy) also may be considered 
rating 2 ntext. The therapists showed a high 
in this 3 cance in codicting the individual 
—s t when the codictions are summed 
items, y e ds’ scoring system the relationship 
fe rofile based on the patients’ responses 
to the = y impressive. Perhaps the items do 
is not ing 4 the same way for our group of 
is pist as they do by the scoring pro- 
thaepe The high correlation between the 
Re k rank ordering of the needs as a 
t T the patients and the profiles derive 
PES he individual codictions suggests that 
from ee when forced to use the 15 
mei t needs are in agreement with the 
Do ystem as to which items relate to a 
omne But these 15 needs are not the 
Pial ns underlying the therapists’ codic- 
amen may speculate that the accuracy on 
a te dividual items results from a different 
: A of reference than that on which the 
a stionnaire is based. Perhaps the more fun- 
aes question is whether the scored di- 
mensions of the test are the same as the per- 
sonality dimensions of the patients. Be 
The lack of relation between the goal re- 
sponses or the importance ratings and the 
codictions made by the therapist indicates 
that the therapist’s orientation is not related 
to his knowledge of the patient. While it 
might be expected that the goal-set responses 
would differ from the codictions, that is, that 
the therapist would want the patient to be- 
come something different than he now per- 
ceives him as being, there is no clear negative 
relationship. One might also have expected 
that those areas which were considered more 
important by the therapist would be those of 
which he was most aware and thus those for 
which he could codict most accurately. This 
was not the case. Rather, the goals appear to 
be closely related to what the therapist him- 
self is like. Correlation between the goal-set 
responses and importance scores leads to the 
possible conclusion that therapists are more 


concerned with those attributes they want the 
patient to achieve than with those attributes 


they would like the patient to minimize, To 
combine these last two statements, we may 
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push our conclusions a bit further and say 
that it is more important to the therapist that 
the patient exhibit the same dominant needs 
as he (the therapist) does than that the pa- 
tient minimize certain aspects of his own cur- 
rent functioning. The focus is on what one 


should be rather than on what one should 
not be. 


Summary 


The structure of Psychotherapists’ under- 
standing of their patients was explored in a 
study of nine therapist-patient pairs. The as- 
sumption was that therapists have different 
degrees of understanding of the various needs 
of their patients. From the patients’ responses 
to the Edwards Personal Preference Schedule 
and the therapists’ utilization of the schedule 
under a variety of instructional sets, the fol- 
lowing conclusions are suggested: (@) thera- 
pists are aware of what they know and do 
not know about their patients, (b) therapists 
are consistent in their evaluation of their pa- 
tients at a more concrete and at a more ab- 
stract level of formulation, (c) the goals that 
a therapist sets for the patient are related to 
the therapist's personality structure, (d) in 
Setting goals for his patient the therapist is 
more concerned with what the patient should 
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be like than with what he should not be like 
The conclusions are offered tentatively of 
cause of the small size and limited ree 
the sample both with respect to the tme 7 
and patient populations and the areas 0 
sonality investigated. 


Received September 17, 1958. 
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DIF- 
ASSOCIATION TERNER aoe ANI 
NTIATED ON i 
nii FEST ANXIETY SCALE 


E 3 AND NALD H. KAUSLER 
PHILIP TRAPP AN DONALD U! 
8 


University of Arkansas 


Theoretical studies on the Taylor Manifest 
nxiety Scale (MAS) have mainly been ¢ 5 
cerned with the relationship of MAS tM AS 
tive level. The likely possibility that a. 
“Cores may also reflect differences eee as- 
imensions, such as differential habit r foe 
“ciative tendencies, has been frequent 1955; 
jaunded (eg, Child, 1954; Farber, 19555 
azarus, Deese, & Osler, 1952), i been 
ttle empirical evidence has actually iew. 
adduced, Farber (1955), in a recent ee eis 
“ptly summarizes the untenable gan “stating: 
Particular property of the MAS prs what 
* +. it is not as yet entirely cer rt from 
these habitual differences may be, PERN at 
© trivial observation that they Rena 
fast in part, in the kinds of verbal r 
Siven on the test itself” (p- 324); to investi- 
he present study was designed sociative 
Bate the nature of some of DRS scores. 
tendencies presumably related to 2 ctly from 
Since the MAS was developed dien reflect 
tems of the MMPI ae E 
anifest symptoms of the anxiey A5 MAS 
Should follow that high scorers. x attributes 
Would Produce associations wit Saol 
[> Similar to those expected in a 5 Of com- 
Clinically anxious subjects a ents 
only ascribed attribute of eens high 
Clinically anxious Ss is the sea nectlons 
‘Portion of negative tones OF 


i is study 
erefore, fhe approach taken in this 


ompa: orti cies 
to c tionate frequen 
pare the prope À e 
negatively toned associations elicited from 


li 


grant from the 
h Fund, Univer- 
yi ity of Arkansas. Edwar" 
ME the data. 
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igh a rers on the MAS to some 
i ori ilis aah. The selected stimulus 
=e ee a list of nonsense syllables. Line 
ing that MAS scores would reflect eee 
associative patterns, the hypothesis was state 
as follows: Ss scoring at the upper catrene on 
the MAS will reflect significantly more nega- 
tively toned associations to a list of nonsense 
syllables than Ss scoring at the lower extreme 
on the MAS. 


Method 


Subjects. The Ss consisted of 43 students, 
male and female, in general psychology classes 
at the University of Arkansas. They repre- 
sented the two extremes of scorers on the 
MAS from a group of over 300 students. The 
Ss were tested during regular class periods. 

Procedure. The 320 nonsense syllables in 
Hulls (1933) list were prepared for group 
administration in a booklet containing 20 
pages, with 16 syllables to the page, arranged 
in random order. The Ss were informed that 
they were participating in a study of the as- 
sociation value of nonsense s 


yllables. They 
were instructed to look at each syllable briefly 
and, if the syllable aroused any particular 


thought or idea, they were to write it down 
on the separate answer sheet. The use of a 
template restricted their attention to one syl- 
lable at a time. 

The MAS was given some two weeks to a 
month later, disguised as a biographical in- 
ventory, by a different E. A short form of the 


inventory, consisting of the 50 anxiety keyed 
items and 40 buffer items, was used. The Ss 
Were informed that Æ was collecting bio- 
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graphical information about students at Ar- 
kansas to compare with students elsewhere. 


Results and Discussion 


To simplify the statistical treatment of the 
data and control for possible group differences 
in total number of associations, 25 associa- 
tions were randomly selected from the answer 
sheets of the Ss scoring at the two extremes 
on the MAS. The high scorers (Group HA, 
N of 21 scored 28 or above on the scale; 
the low scorers (Group LA, N of 22) scored 
6 or below on the scale. The groups consisted 
of approximately the top 10% and bottom 
10%, respectively, of the total distribution 
of scores. Each set of 25 associations was 
then typed on a Separate answer sheet and 
coded with respect to group identity. 

Two judges, staff psychologists at the Uni- 
versity of Arkansas, independently evaluated 
each association, classifying it as Positively 
toned, negatively toned, or neutrally toned, 
A total of 1,055 judgments, consequently, 
were made. Percentage of agreement between 
the two judges was 92. 

A summary of the means and standard de- 
viations of the Positively toned and negatively 
toned associations for the two Sroups is pre- 
sented in Table 1, 

The hypothesis that high scorers on the 
MAS would reflect significantly more nega- 
tive associations than low scorers was con- 
firmed by the ¢ test beyond the .001 level 


Table 1 
Summary Data of Number of Associations to 
Nonsense Syllables 


Negatively 


eg Positively 
T oned Toned 
Associations Associations 
—— ce 
Group Mean sp Mean sp 
= Serene a 
HA (High Anxious) 6.29 2.19 210 1.26 
(N = 21) 

LA (Low Anxious) 2.91 1.74 2.55 1.47 


(N = 22) 
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(t= 5.75; p< 001). Incidentally, no 
nificant difference was found between EE 
groups with respect to number of positi a 
toned associations (ż = 1.09; p > .05). both 
preponderance of associations made by jety. 
groups was of the neutrally toned varie Hs 
This would be expected from the nature 
the task. š 

A check was made on the sex di 
of the two groups, and no appreciable fee 
ence was obtained. Group HA consisted 0 (a 
males and 8 females, and Group LA Cn ete 
of 16 males and 6 females. Hence, the kely 
ence in the obtained associations is unl į 
an artifact attributable to the sex variab ra 

The findings thus support the theore Ss 
Position that the MAS does differentiate n 
on associative factors as well as the more n 
quently investigated nonassociative meg 
other words, evidence is offered that ing 
Scores reflect, in addition to the meet 
component of a motivational state, a per 
component, which some writers (e.g., Do” 
& Miller, 1950; Farber, 1955; Hull, 
Shaffer, 1936) feel is an essential require™ 
of a motivational variable. 


Summary 


Ta OF 
The present study was an investigation a 
Some of the associative tendencies that al 
be reflected in MAS scores. The response] 
terns of 21 high scorers on the MAS E 
low scorers were compared in terms P eion 
frequencies of negatively aroused dasoa hea 
to a list of nonsense syllables. The hypo e 
that high scores on the MAS would pror ely 
a significantly greater proportion of Heee 
toned associations was confirmed beyond 5 
001 level (¢ = 5.75; p < .001). The srr 
reflected, on the other hand, approxima a 
the same proportion of positively toned as D 
ciations. The sex ratio was nearly the sa 
both groups, thereby eliminating the pO a 
bility of the sex variable confounding the son 
sults. Hence, the most probable explanal) a 
is that MAS scores do reflect differential 4 
sociative tendencies. 


the 
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AN IMMEDIATE MEMORY MODIFICATION OF 
THE BLOCK DESIGN TASK: 


RELATIVE PERFORMANCES OF BRAIN- 


DAMAGED AND 
CONTROL SUBJECTS: 
ALFRED B. HEILBRUN, JR: 


State University of lowa 


s 
3.0 nced a 
gn procedure re- fore procedural revision could be adva 


nstruct block pat- a diagnostic improvement. 
as a continual ref- 


5 jon 
The present study evaluated a modina 
erence source. Under these conditions the task of the standard block design procedure e em- 
quiring S to construct the designs from f the 
difficult for Ss with brain damage when com- ory immediately following exposure 0 was 
stimulus card. The modified procedure ai 
based on the hypothesis that a combi e- 
of two Psychological processes, each youl 
?  Pendently sensitive to brain damage, Y ent. 
» Goldman, & Coon, 1946; Hécaen Produce an eyen more sensitive instrume 
de Ajuriaguerra & Massonet, 1951; Heilbrun, ince numerous studies (Anderson, 1951; 
1954; Lidz, Gay, & Tietze, 1942; McFie & Benton, 1953; Cohen, 1952; Collins, dall, 
i McFie, Piercy, & Zangwill, Diers & Brown, 1950; Graham & Ken 
1950; Milner, 1952; Paterson 


$ 5; 
& Zangwill, 1946; Halstead, 1947; Heilbrun, in P Hi 
1944), Hoedemaker & Murray, 1952; be 
There have been attempts to modify the Young, 1954. Reynell, 1944; Rues 
standard block desi 


sts 
Moore, 1943) have demonstrated ee A i- 
of immediate memory to be differential Yadure 
is Block Substitution cult for brain-damaged Ss, the new proc pro- 
est requires that an § Copy a set of blocks should provide evidence regarding the 
n a drawing. In addition, the test Posed hypothesis, 


is required to copy all six Method 
sides of the model, i Subjects 


sontS 

i f The 83 Ss used in this study were patie 

R k ae a at the University and Veterans Admin aa 

oe tion Hospitals, Iowa City. This ae 

Neither cluded 40 brain-damaged Ss wit eri. 

ison be- Cerebral pathology, obtained iron A ysi- 

k design Cal or neurosurgical services, aa fae Me 
sary be- Cally ill normal Ss who had no histo y 


unc- 
displayed any evidence of cerebral dysf 
was supported by 


(B-616) f the National T a research tion. ante 
grant -61 rom the Nationa nstitute of Neu- 3 A n roup was divided in 
rological Diseases and Blindness of the National Each diagnostic g p 

Institutes of Health, 


: ter, 
i i to be described la 
United States Publi H experimental subgroups j for 
Service. EaR all groups being appropriately matched 
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ig: st 
A Modification of the Block Design Tes 


Table 1 


Age and Education Data for the Brain-Damaged 
and Physically Il] Control Groups 


Age Education 

D 

Group N Mean SD Mean S. 

7 2.50 

Brain-damaged 1 21 36.10 9.18 ae ve 

Physically ill1s 23 3796 832 10.68 227 

rain-damaged 2 19 36.79 11.73 985 256 
hysically i2% 20 34.50 10.17 i 


lese gron 
he: 


ATI 
“Ty 


ved i e study. 
Ds were directly compared in re study. 
SS groups were directly compared in 


âge and education. The data for men E 
and education variables are presene s or 
able 1. None of the differences a ened 
“atiability approached statistical SP eluded 
“YO Ss over 50 years of age bog detri- 
m the study so as to control for the of in- 
Mental effects of aging upon this E was 
tellectua] performance. Also, any E st half 
not able to perform correctly on at a under 
he block design items administer ng 
Standard conditions was diminaten. Ss from 
Virement excluded grossly impaire 
consideration, 


Task 


the 
Twenty block designs, collected e ateli- 
Wo forms of the Wechsler-Bellevu or con- 
Sence Scale and the Kohs AE a set 
Structeq by E, were combined reproduced 
‘orm A), Each design could be arallel form 
Y using four Wechsler blocks. A P aohstructed 
or this task (Form B) was tE or rotation 
Color reversal, mirror IA 20 college 
the designs. A pilot study us! P diff- 
found these two tasks to be 0 immediate 
Culty when administered by eh each form 
mory procedure. Two Sd leaving 18 
Were used as demonstration i The items in 
“st items to be Lees of hemp 
orm e placed 1 judgments o 
ie as determined EES Each 
: inic: > 

Form B item was automatically placed by 

the judged position of its ma 
“orm A. jen task required the 
pte stance ON Da within a 60-sec. 

° copy fou 
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time limit with the design continuously in 
in 
i r reference. s . 
me the immediate memory tie ae 
i s or ‘4 
a design was expose x 
er ag a An S was then given oe 
ame with which to construct Sees 
ton Beny within the 60-sec. time limit. 


zorin. 
a PA for block design perone 
aodeled after and similar to at usi : 
he W hsler-Bellevue. Four points were a 
F y “i a design were constructed without 
se vithin the 60-sec. time limit. Further, 
ihe f jlowing speed credits were given when 
T T yas accurately reproduced: three 
z e 15 sec.; two points, 16-30 sec.; one 
Lar 31-45 sec: Accordingly, a maximum 
ee 126 points was possible for the 18 
sc 
rt block design task was discontinued 
Bsa aa errors on five consecutive trials. 
a 


Procedure 


Approximately half of each diagnostic group 
was assigned to two order conditions. In one 

der condition, Ss were given the immediate 
3 ory procedure first and the standard pro- 
N ae eatoni, while the remaining brain- 
Taa and control Ss were given the pro- 
cedures in the reverse order. In either case, 
the two measures were separated by inter- 
polated psychological tests requiring about a 
half hour to administer. Within both order 
condition, Ss were alternately given the mem- 
ory procedure on Form A and Form B. 


Results 


The hypothesis of differential difficulty for 
brain-damaged Ss on the memory procedure 


was tested by comparing the scores on the 
standard and memory tasks for each S. These 
performance differe: 


nce scores were then av- 
eraged over Ss in the brain-damaged and 
control groups. The critical test of the hy- 
pothesis was the 


difference between these av- 
erage group difference scores. 
Table 2 presents th 
sons for the tw 


under the tw 


€ performance compari- 
© block design procedures 
© order conditions. It can be 
seen that the 


brain-damaged group showed a 
Sreater difference in scores for the two ad- 
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Differences in Mean Scores for Brain-Dai 


maged and Control Ss for Two Block Design 


Alfred B. Heilbrun, Jr, 


Procedures Under Two Order Conditions 
Brain-Damaged Control 
Order Regular Memory Regular Memory Difference’ 
Condition Procedure Procedure Difference Procedure Procedure 
Memory procedure 7 43.91 
first 98.62 41.34 57.28 109.56 65.65 
Memory procedure 33.40 
second 93.26 46.84 46.42 101.95 68.55 me 


second condition (= 


Discussion 


The hypothesis that the combination of two 
Psychological Processes, each independently 
Sensitive to cerebral Pathology, would provide 


complex Processes as jn- 
dicators of cerebral Pathology, 


The question could be raised as to how the 
block design memory task compares jn dis- 
criminative efficiency to the standard task 


iff- 
used in the present study and to a ae pes 
cult block design task using standar 
cedures, the 
An analysis of the overlap data ae de 
Memory task in the current study foun opti- 
under the memory-first condition, we ssifi- 
mum cutting score provided correct cla 
cation for 14 of 21 brain-damaged Ss a o 
of 23 control Ss, an average efficiency a 
about 73%, Under the memory-second Cy- 
dition, an optimum cutting point on the 120 
ory task led to Correct classification for 158) h 
brain-damaged Ss and 15 of 20 yee 
with an average efficiency of about 697% ina- 
In comparison to these average gen 5 7 
tive efficiency figures of about 73% and use 
for the memory task, the standard task tifie 
in the present study maximally ident: rst 
about 70% and 65% under the memon 7 
and memory-second conditions. ‘These 5 rrec 
ard procedure figures are based upon eae 
Classification of 12 out of 21 brain-damagr 
Ss and 19 of 23 control Ss (memory-first d 
dition) and 16 of 19 brain-damaged SE Bn 
of 20 controls (memory-second condition): m 
The results of a previous study by ing 
brun (1954) provide a basis for ompr i 
the memory task with a more difficult sta y: 
ard block design task. In the earlier stu lly 
100 Ss (71 brain-damaged Ss, 29 physis i 
ill control Ss), selected from the same ere 
pitals as the Ss in the present study, "ie 
given the block design subtest from ns 
Wechsler-Bellevue under standard ing 
as part of a larger test battery. It was fou r 
that this block design test provided bette 
discrimination between brain-damaged Ss an 
controls than any of the other 14 tests in the 


A Modification of th 


battery, accurately classifying an average ol 
about 72% of the Ss in these two groups 
after selection of an optimum cutoff score. 
The diagnostic comparison between the sa 
Mediate memory block design procedure an 
the standard Wechsler block design test does 
not suggest that the former provides a more 
Sensitive task for the detection of Tabs 
aged Ss. Further, the comparison epee? res 
Memory procedure and the standard task the 
lized in the present study does not favor the 
memory procedure as a discriminative ig 
Ment in any clear-cut manner. However, t n 
Scoring system used in this study was po 
fcause it seemed to best allow for a direc 
Comparison between the current standard gil 
cedure with block designs and a modified pi 
cedure, Tt seemed of interest to try at bacon 
One other scoring system to hehe 
Whether the obtained levels of discriminati : 
‘ficiency represented actual upper i a 
© memory task for these samples x, a 
ittiicial limits imposed by the mode of scor- 
ings It was decided to score by the number © 
dividual blocks (i.e., there are 1em faced 
vidual blocks per design) correctly Tons 
Within the time limit with no time mae 
Scores, This more precise scoring me sai cut- 
. Performance, again using an pimi brain- 
N score correctly classified 17 of s under 
damaged S and 17 of 23 control st cor- 
the Memory-first condition, an p der the 
tect Placement of about e mn cutting 
mory-second condition, acre 19 brain- 
led to correct classification for 13 © n average 
maged Ss and 16 of 20 controls, a nore pre- 
“ficiency of about 74%. Using tes "efficiency 
tise accuracy score, the maximum ximately 
for the Mandard procedure was p (10 of 
65%, for the memory-first on 23 controls 
rain-damaged Ss and 19 E 62% for the 
€ctly identified) and abo of 19 brain- 
€mory-second condition (1 trols correctly 
„amaged Ss and 10 of 20 con ch based on 
centifiea). These findings: torg | the no- 
Small samples, give more snp procedure come 
Hon that the present me e standard pro- 
Dares favorably to se cl designs or the 
Ure using simple four- 


d scored Wechsler 
Ndardly administered en ot cerebial a- 


Corr 


Sta 
task relative to the pre 
thology. 


e Block Design Test 
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Tt should be noted that using this bog a 
cise error scoring system, significant = a 
between brain-damaged and contro as 
= ade relative performances under the on 
ad inistrative procedures were demonstrable. 
U E the memory-first condition the t value 
n 3.51 for 42 df (p < .001), while under 
he tit ory-second condition the ¢ value was 
fe — 37 df (p < .01). In both compari- 
on a brain-damaged showed | ene 
relative impairment on the memory aa 
finding that discriminations à 
ampa and control Ss was oe ; 
bonus scores were not assigne 
om f performance (in addition to the more 
ane yea scoring) raised the meras 
eee sibility that speed of performance di 
a ps the differential decline when the 
eee block design procedure ht roe 
pared with the somam Pe nas 
peed shov a 
g jaa Teni slower than con- 
a tt that the speed differences between 
Fine diagnostic groups decreased en the 
memory procedure, though the trend did no 
ach statistical significance. This finding 
Eor in contrast to the finding that brain- 
a ed Ss show a reliable increase in im- 
sta with the memory procedure when 
only performance accuracy is considered. 

Tt should be emphasized that the findings 
of the present study do not warrant utilizing 
this particular memory task as an individual 
diagnostic measure. This study was primarily 
concerned with the effects of combining block 
design and immediate memory procedures 
upon the performance of Ss with cerebral 
damage and not with the construction of a 
diagnostic test. Considerably more research 
would be necessary before any such practical 
application would be warranted. 


Summary 


1. This study investigated the hypothesis 
that the combination of two psychological 
processes, each independently sensitive to the 
effects of cerebral dama 
complex task of incr 
bral pathology. 


2. Performances of Ss with confirmed cere- 
bral pathology and matched physically ill Ss 
showing no history or current evidence of 


ge, would provide a 
eased sensitivity to cere- 
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cerebral damage were compared on two block 
design procedures—the standard copying pro- 
cedure and an immediate memory procedure. 

3. The prediction of differential difficulty 
on the memory task for brain-damaged Ss was 
supported by the data. 

4. Consideration of the overlap data 
this study and the relev: 
study suggested the relative diagnostic use- 
fulness of a block design memory procedure 
when a more precise evaluation of perform- 
ance accuracy is utilized. 

5. Comparison of the results 
accuracy and speed of 
lyzed separately suggest 
aged Ss show differenti 


in 
ant data from another 
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FACTORS 
PERSONALITY AND BACKGROUND 


ELI 
IN JUVENILE D 
FERRED FROM Q 


IN- 
NOUENCY AS 
NESTIONNAIRE 


RESPONSES * 


TC. 
DONALD R. PETERSON, HERBER 


QUAY,? AND GORDON R. CAMERON 


University of Illinois 


. Most investigations of personality a 
m crime and delinquency have begun W! ded 
gally defined sample of offenders, procee ; 
With various comparisons between that ae 
a more or less carefully matched ail = 
ot Nonoffenders, and ended with ee 
results, After reviewing 113 such egies ted 
WaS, Scheussler and Cressey (1950) ihe 
that “The doubtful validity of many An p 
obtained differences, as well as the Re i 
iwusistency in the combined results, ma that 
“Possible to conclude from these aa as- 
cininality and personality elemen S nes 
Sociateq” (p. 476). Like all negative a eset 
Wever; these can be interpreted in ental 
io Ways, viz., as evidence for offenders 
entity between offenders and spasequences 
respect to personality, or as i a the lat- 
Methodological failure. We belie ible than 
\" interpretation to be more pans, Jaring 
the first, and submit that the mos Sle in 
defects in many previous investiga fai legal 
the gross behavioral heterogeneity troments 
Offenders and inadequacies in the condition is 
used to examine them. The first co of all ob- 
likely to Jead to serious cape A | 
"ved relationships, and to ow correlations 
Most unimpressive array of low d condition 
small differences. The nea s beyond 
ikely to obscure true relationship: 
recognition. ter care 
S A o we propose P OR cer- 
be exercised in defining and ideally demon- 
ain personality traits of emp! 
1 


all 


ted by a grant 
Sa C h were supported 9y a 
ETE eE this ee esearch a aie in the 
e insti . iversity. 
cial Sciences, Vanderbilt ety. 
* Now at Vanderbilt Un? 
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i in the predisposition to 
ahaha ne and that subsequent a 
eae concentrated upon the origins an 
aa aces of these tendencies, rather than 
e dined but premature search for the 
ae d outcomes of delinquency itself. 
‘the & i oree basei inference of constructs 
ien relate to delinquency, the Sevelopmen! 

ressively more adequate measures o 
k P girls and the patient delay of the 
a r causål antecedents until such steps 
cake “a is slower and more restrictive than 
ei a File earlier approaches, but it promises 
Een of explanatory depth and precision 
which the older methods can never afford. 

The present study is an attempt to define 
such constructs through the factor analysis of 
two sets of questionnaire items previously 
shown to differentiate between delinquents and 
nondelinquents (Gough & Peterson, 1954; 
Quay & Peterson, 1958). The initial mode of 
item selection has guaranteed that these re- 
sponse tendencies have something to do with 
delinquency and, in fact, one of the item sets, 
comprising the Socialization Scale of the Cali- 
fornia Psychological Inventory, has displayed 
a degree of construct validity truly unusual 
among personality tests (Gough, 1957; Gough 
S Telersony LE Peterson, Quay, & Ander- 
son, 1959). Inspection of the items, 
reveals a diversity of content and 


nearly as great as for delinquency it 
this analysis was undertaken in t 
that factor analysis could lead to 


tion of a set of reasonably unitary, 
ent 


however, 
meaning 
self, and 
he belief 
the educ- 


independ- 
» Possibly meaningful constructs that would 


offer more powerful hypotheses for further re- 
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search than is provided by the original more 
heterogeneous measures, 


Subjects and Procedure 


In an effort to maximize variance along 


dimensions of primary concern, both delin- 
quents (N = 116) and nondelin 


L 


Quay, and G. R. Cameron 


irst; 
Rotations were pursued in two ways. F 
an orthogonal analytic solution nes ye the 
by means of the quartimax roo wriglel 
electronic computer (Neuhaus & but not 
1954). This yielded an acceptable of 
strikingly impressive solution, in rll hyper- 
usual criteria of simple structure. Ue vel by 
Planes were significant at the 05 “inepti 
Bargmann’s (1954) test, but visual olution 
tion of the plots suggested that the i A 
might be improved somewhat by otate 
shifts. The centroid factors were then ane 
to an oblique analytic solution by we an 
the oblimax routine for the a i- 
this was followed by a series of visua prov’ 
rected rotations until a virtually um anes 
able solution had been found. All — sig 
defined by these latter operations Tatercot 
nificant far beyond the .001 level. ee 
relation of loadings, however, corona ve 
that the two independent solutions big = ors 
Closely similar (r’s for analogous icity 
ranged from .89 to 99), and the eee 
and objectivity of the orthogonal qua ation 
solution led to its choice for pian free 
here. The factors given below are utter Y fiet 
of contamination by interpretative bias, 


ace, 4” 
the Simplicity of an orthogonal space; 


Table 1 
Factor 1; Psychopathy 
No. Loading No. Loading 
18 64 The only way to settle anything is to lick 6 43 It's dumb to trust older people. dares 
E the guy, S A Ewoulddo‘almost anything ao me 
62 Winning a fight is more fun than any- | 33 43 If somebody does something 
a a thing. always get them back. re more 
he People that run things are Usually | 30 42 Most brothers and sisters a 
7 r against trouble than they are worth. j trouble. 
7 es Ops usually treat you dirty 32 40 Idon’t mind lying if I am in bad trou ple 
you Nee save enough to live on, it's 70 40 I go out of my way to mo 5 
o steal, ats 
s a rather than try to escape bo 
ce Z A lot nf times it’s fun to be in jail, 40 39 Ido what I want to, whether any 
35 53 che Way to make big Money is to likes it or not. hen thing? 
s 14 —38 I would rather be at home w 
47 52 A Person is better off if he doesn’t trust go wrong. f fight 
34 51 ralin 20 35 T got (or used to get) into a lot o 
f the cops don t like you, they will get in school. 
m 48 o Fe for anythin - 98 34 I never cared much for school. _ king- 
us usually hands me à pretty Taw deal 84 33 T have never done any heavy drin se m. 
22 46 Cops and judges will tel] you one thing | 19 33 Thave run away from home becau 
and do another, folks treated me bad. 
21 43 A guy like me hits first and asks ques- 10 32 
tions later. 


t along 
I'm really too tough a guy to ge 
with most kids, 


a es: 5 U” 


Personality Factors in Juvenile Delinquency 
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Table 2 


Factor 2: Neuroticism 


Á papam 


No. Loading 

ee S ee ia 

38 68 I often feel that I am not getting any- 
where in life. 

Sometimes I used to feel that I would 

67 S like to leave home. 


49 5 


56 I seem to do things that I regret more 
83 ` often than other people do. ' 

55 I have often gone against my parent's 
64 wishes. 

54 My parents often disapproved of my 
100 friends. 

52 I sometimes wanted to run away from 
94 p home. 

52 T often feel as though I have done some- 
95 5 thing wrong or wicked. s 

51 I don't think I'm quite as happy 3 
93 others seem to be. A g 

48 People often talk about me behind my 
101 i back. Si r, 

4T With things going as they are, it’s pretty 

hard to keep up hope of amounting to 

68 something. i 

44 T would rather go without something 
42 than ask for a favor. , 

43 T sometimes feel that I made the wrong 
63 choice in my occupation. u 

E (66 42 T have very strong likes and dislikes. 

40 I often act on the spur of the moment 

— without stopping to think. 
— peene 


ar : 

i for all practical purposes, equivalent to 

the lique solution which is unassailable on 
Srounds of simple structure. 


Results 


ie Combined questionnaire as it was 
trix ally administered, the centroid factor ma- 
> and the rotated factor matrix are re- 
tted elsewhere.* The factors will be defined 

hag state in order of descending variance, by 
| of Ment of the items which have loadings 
te or more. A positive sign for any load- 
ci implies that the response “true” is asso- 
e eA with the positive pole of the factor; a 
į Sative sign indicates that a “false” response 
t associated with the positive pole of the fac- 
t. Item numbers refer to the variables as 


€Y appeared in the questionnaire as used 


a 
tri The combined questionnaire, centroid factor ma- 
Fa with and rotated factor matrix have been deposited 
i Docu e American Documentation Institute. Order 
{ ors ment No. 5920, remitting $1.25 for microfilm 
$1.25 for photocopies. 


No. Loading 
41 39 I get nervous when I have to ask some- 
one for a job. 

3 39 Sometimes I feel (or used to feel) that 
if I could just get away from home, 
everything would be all right. 

22 38 Cops and judges will tell you one thing 
and do another. 

75 37 In school I was sometimes sent to the 
principal for cutting up. 

4 36 My folks usually blame bad company 
for the trouble I get into. 

$7 —35 Most of the time I feel happy. 

69 34 Ihave more than my share of things to 
worry about. 

81 33 Itis hard for me to act natural when I 
am with new people. 

11 32 It isn’t their fault that most guys get 
into trouble. 

7 32 My folks have sometimes been in trouble 
with the law. 

28 32 When I was a little kid, I was always 
doing things my folks told me not to. 

96 32 I used to steal sometimes when I was a 
youngster. 

74 —30 I have never been in trouble with the 
law. 


herein and as deposited with the American 
Documentation Institute. 

Tough, amoral, rebellious qualities are ob- 
viously implied by the variables given in 
Table 1, and these meanings, together with 
those of impulsiveness, a conspicuous distrust 
of legal and other authority, and an apparent 
freedom from family ties, led to our desig- 
nation. Factor meaning seems very close a 
that of “Unsocialized Aggression,” as identi- 
fied in the work of Jenkins and his colleagu 
(Hewitt & Jenkins, 1946; Jenkins & a a 
man, 1947), and strongly involves the 2 
disregard for public opinion s ERA 
in the “Psychopathic Personality” ee 
which emerged from Comrey’ ity” dimension 

Y's (1958) factor 


analysis of the Psych i i 
ee arr Opathic Deviate (Pd) 


Tendencies toward impulsive 


appear in Factor 2, but the intr 
emis and perhaps the dyn 
the behavior are decidedly not 


action again 
amic bases, of 
psychopathic, 
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Table 3 
Factor 3: Family Dissension 
No. Loading 
39 61 My mother and father argue a lot. 
36 60 My step-father (or step-mother) treats 
me badly. 
104 —49 My home life was always very pleasant. 
103 49 Iwas often punished unfairly as a child 
99 —46 ‘The members of my family were always 
very close to each other. 
37 41 My folks yell at us kids a lot. 
13 39 My mother and father have never really 
been friends of mine. 
65 —39 My home life was always happy. 
56 38 My home life as a child was less Peaceful 
than those of Most other People. 
19 36 ave run away from home because my 
folks treated me bad. 
29 36 


ave lived in an orphans’ 


foster home at Some time, 


home or a 


guilt, depression, discour- 


y Jenkins and 


Glick- 
man (1947), and to the “ 


Neuroticism” factor 


Table 4 


No. Loading 
44 43 T have never been in trouble with th 
2 41 Tam behind at least a 
b year in school, 
z z amt school now if they would ich me, 
en I was goin, to school T 
hooky quite often, e Gaye 
82 35 ia Something goes wrong I Usually 
ame myself rather than t 
A he other 
62 34 T hardly ever Set excited or thrilled 
80 3 T enjoy work as much a 
25 30 y folks move (or used to Move) from 
place to Place a lot, 
44 30 I woul have b 


een more su 


people had given me a fair 


Ccessful if 
chance, 


D. R: Peterson, H. C, Quay, 


and G. R. Cameron , 
inter- 
which suggested “Inadequacy” as Ei is 
Pretative label, and the general imp with 
indeed that of an inability to he meaning 0 
problems of a complex world. The nd our i 
the factor, however, is obscure a 
terpretation tentative, , interpret than 
This factor is no easier to in howevel 
Factor 4, Only three of the we these 
attained very high loadings, an ry of con 
Stand in some relationship to a We we have 
flict with school authority. The tit “history: 
tentatively attached implies such a 


Table 5 


şi ent 
Factor 5: Scholastic Maladjustm 
e 


No. Loading e 
1 IP 

92 48 When I was going to schoo the 

hooky quite often. «mes sent t2 
75 47 In school I was sometim ive 

Principal for cutting Ra used to 8 
52 47 As a youngster in school Fe 

the teachers lots of op | costs: -ple 
1% -34 keep out of trouble at a pad tro! 
32 34 I don’t mind lying if I aT aol. Pe 
98 33 I never cared much for sc! when 1 W 
96 33 I used to steal sometimes P and 

oungster, righ 

se TETI I think t am stricter Ai 

Wrong than most people. ‘ly. ts’ 
91 30 I have used alcohol GERY aren 
83 30 Ihave often gone agains 

wishes. 

Summary 


5 delim” 
Research on personality factors ie gron 
quency has long been impeded OY ae m 
ehavioral heterogeneity of cel used ‘° 
Various inadequacies in the eae o ques 
Study them. A factor analysis o ffectivene™ 
tionnaire scales of demonstrated e nondeli? 
in differentiating delinquents oe that f° 
quents was conducted in the belie sequel 2 
ture research on the origins and a thus de 
of mediating personality Pendens progress 
fined would lead to greater Scienta al de- 
than direct investigation of eel dimensions 
linquency itself. Three personali ited 
and two background factors TOBE of psy” 
first was characterized by a num ed accore- 
Chopathic qualities and was eae E anti- 
ingly. In the second factor, imp ressions © 
Social behavior covaried with exp 


OC 


Personality Factors in Juvenil 


` 

re 

ee, pression, and other negative affect. 
The third erpreted as a neurotic dimension. 
a general at personality factor implied 
garded as nse of incompetence and was re- 
the two it expression of inadequacy. Of 
lated to “A ground factors, one clearly re- 
seemed ae dissension, and the other 
tory of di ch less clearly, to relate to a his- 

ifficulty in school. 


Rece: 
ceived August 7, 1958. 
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Veterans 


Hon NO. win 
OBESITY PaTHKocy "ie 


i 
i—i 


ITY PATHOLOGY Lows 
3 (Ei am) 


GE 
‘ADAPTIVE 
CRITERION 


1 Based on a Paper read 
Congress of Psychology, 

? For many helpful s sti 
couragement the i 
Robert C. Tryon 


at the Xy International 
Brussels, July, 1957, 

and for their en- 
cially Brateful to 
ough, 


Administration Hospital, San Francisco, California 


re 
aP 
only one segment of t 


criterion relationship." _ 
Several years ago, in analyzing Gonda; 
of a cross-validation study (Fisher, hach, ™ 
Little, 1955) involving the Pon consist 
colleagues and I noted a curious bu ielde 
ent result, When the Rorschach in diseas 
score indicating the presence of om criterio” 
the agreement with independen extraord 
judgments of brain pathology was noweve! 
narily good (94%). A low scote psence i 
Was not accurate in predicting the eae cien 
rain pathology, A Pearson validity epectable 
Was computed and found to be a re 
Significant, but humble .32. dard ne 
Next, we subjected several stan OE , the 
rologic Procedures, such as the 


predictable in 
dictor- he resulls 


ne 
i e san 
lumbar Puncture, etc., to essentially thé 655). 
validation analysis (Fisher & Gonda; 7" oy 
Exce; 


Pt for a few minor variations, Ey sari 
rologic diagnostic techniques gave patho 
results: High accuracy in predic ine Ta the 
°8y from positive test findings, Or ng i 
Rorschach, poor accuracy in pre ig diag 
absence of pathology from nega efficients 
nostic signs. The over-all validity € 
ranged from .13 to .32. f thet i 

When scattergrams were plotted o an the 
lationship between predictor scores config 
criterion, a nonlinear heteroscedastic twiste 
ration was revealed which looked like a is And 
pear; it is approximated in Fig. 1. p peat 
ing raised the question: Is the twis ral pat 
unique to these data or is it a Pe tent? 
tern, characteristic of prediction pro oie 

* Cronbach and Gleser (1957) have recenti in 
sented a similar argument to the one para aie o 
this paper, based on the mathematics and f 


dit- 
Frea o: 
decision theory, for considering the problem 
ferential validities in psychological testing. 
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The diagram will call to mind many fa- 
miliar observations and findings. When scat- 
tergrams from several sources are examined, 
Where more or less known criteria are plotted 
against more or less standard predictors, €-8-: 
ective tests, a linear relationship with rela- 
ely little array variance will be observable 
àt one end of the plot. The relationship, how- 
ne becomes increasingly nonlinear and in- 
“easingly variable as it approaches the mid- 

© and upper extreme. The terms “adaptive 
‘nd “nonadaptive” are used in Fig. 1 to sug- 
ton an implicit but functionalistic concep- 
he of the corresponding relationships e 
ang è Predictor “good” and “poor” scores 
a the criterion behavior of organisms. : ie 
in a Words, the predictor becomes ie 
oe Predictive of the criterion as the sco e 

tained increase from the “poor” to “good 
` temes of the predictor. To illustrate this 
ster ctor-criterion differential, the findings o 
and les of intelligence, learning, personali 7 ; 
Pathology will be presented and discussed. 
“cording to Fig. 1, the predictive emam 

© IQ at the “poor” extreme should be 
derably better than for average ~ : 
been (superior) IQs. Specifically, with bie 
OW, say 50, it is highly predictable a 
Dlet dividual will require custodial oe ao 
Quin, Protective care, and that he wI po toa 
a any scholastic skills. With IQs of 3 m 
0, there appears to be moderately goc 4 
Predictability that the individual will a 
Woy “lal training and guidance, particular a 
tar hd at school. With IQs of app 

ately 70-85, and, to a, greater degree b 
Ge 85-110, however, vocational and sc ia 
un limitations vs. successes become increa, 
ly difficult to predict. T 
` able 1 summarizes the results of aye 

cae itudina] studies of the vocational an : . 
onal achievements of male mental de : 
yess, their controls, and, in addition, the 

Cational and scholastic attainments of 

Ra's gifted men (Terman & Oden, oe 
as. latter included some 730 subjects w “a 
‘Idhood IQs were 140 or higher and W P 

te classified into two groups by ane on 

\, asis of vocational achievement 1 n xs 

> 1gs The A group (mean childhood IQ = 
| 55) was the most successful and the C group 
in IQ = 150) the least successful. The C 


Cone 
Pa 


401 


group of 150 men, therefore, was, by biel 
nition and rating procedures, an underachiev- 
ing group. Table 1 reveals that as a group; 
Terman’s gifted men, 25 years of age D 

older in 1940, were superior occupationa 7y 
to the general male population in the = S. 
Further analysis of the data (not r n 
Table 1), however, discloses that 287% ot the 
C group fell at or below the tedien oce 
pational level of the employed males in the 
U. S., as well as of those in California in 
1940. 5 Terman and Oden (1947) note that: 


those of highest IQ accomplish more 
well-adjusted, but one cannot any- 
arbitrary IQ line that ag set s 

i i r relative mediocrity. Some 0 
pine a oe achieved most notably did 
Garpar n in childhood or in adult life, rate above 
ewe of the total group in tested intelligence. 


On the average, 
and are equally 
where draw an 


With regard to the lower end of the IQ 
range, Table 1 also gives the occupational 
achievements of two follow-up studies of 
mentally defective groups. The data reported 
are in the form of average percentages for 
the combined groups. Compared to the gifted 
and control groups, the findings suggest a 
stronger, less variable relationship between 
mental deficiency, as determined mainly by 
IQ, and occupational achievement. None of 
the mental defective groups achieve I and II 
occupational categories; 23% are in III and 
IV, and 77% in V and VI. For the control 
samples, whose mean IQs are within the av- 
erage range, the proportion of cases fall in 
the several categories as shown. Approxi- 


4 See p. 361 ff. in Terman and Oden (1947). 

5 The unemployed and incapacitated (N = 16) in 
Terman’s gifted group were not included in the num- 
bers and percentages given in Table 1; in addition, 
those who were classified as students were also 
omitted. A mitigating consideration is the postde- 
pression economy of the period and the relative em- 
ployment “youthfulness” of the entire gifted group. 
Many were still in transit occupationally. 

The same conditions, however, obtain for the men- 
tally defective and their control groups, because all 
of the studies cited in Table 1 were based upon the 
socioeconomic conditions of the decade 1930-1940 
In personal communication with the author, Melita 
H. Oden reported that since 1940, follow-up studies 
of the gifted group have shown intragroup shifts on 
the occupational scale; some C men have moved up 
and others have moved down on the scale; some A 


men have taken positions in lower (III-V 
tions. r (III-VI) occupa- 


Table 1 
Comparison of Educational and Occupational Achievements of Groups of Men Whose IQs Were Obtained in Childhood 


Educational Achievement 


Occupational Achievement 
a ee eee AS Pe a et 


Mean Mean Minnesota Occupational 8th 
IQ at Ageat Follow- Scale” Grade College 
Timeof Timeof upin and 9th- Some Gradua- 
Groups Test Test Years N VI&V IV&IU I&I N Lower 12th College tion 
Terman’s gifted (1940) ey 
A (N = 96) 155.0 149b 150 
B 9.7 18 436 + 10.3% 24.3% 65.3% 481 0.0% 14.7% 18.3% 66.9% 
C (N = 92) 150.0 139 150 
Baller’s (1935) control 107.8 8-9 21 39} iat | - 35) = É 
Fairbank’s (1931) control 90.0 12(?) 47 39) 8.5 40.6 15.9 25/ 36.0 35.3 15.5 13.1 
Baller’s (1935) mental defectives 60.5 8-9 21 H, > 1 2) 
Fairbank’s (1931) mental defectives 680 12 17 69 f 773 22.7 0.0 43f 93.9 6.5 0.0 0.0 
U. S. Census (1940) 44.7 46 138 60.4 20,5 5.5 4.6 
Fa 


a The Minnesota Occupational Scale was used by Terman for the classification of ‘his gifted men. Because the other follow-up studies cited here were conducted and reported in the 
ational Scale was adapted and applied to them aiso. Roe's (1956) more recent two-way classification of occupations gives similar results. 


same decade (1930-1940), the Minnesota Occup : |: ( ‘ tty 
Roughly, the classifications I & II refer to professional and managerial; III & IV—skilled labor and agricultural; V & VI—semiskilled and laborer, 
> The Ns of 149 and 139, respectively, as well as the Ns and percentages of the other studies cited, refer to gainfully employed men only, who were available geographically at the time 


of the follow-up study. r , . : 
e U. S. census (1951) educational and occupational data for men are included for purposes of general comparison. 


COP 
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mately two-thirds of the gifted group at- 
amed superior vocational levels (I and IT). 
© presence of 10 and 24% of the gifted in 
€ lower occupational Categories V and VI, 
and TIT and IV , respectively, however, SUS 
“sts again the greater variability and, hence, 
«Potential predictive “error” associated 
with “good” IQ DER 
Prediction of scholastic achievement by 
es of the IQ was studied by review of the 
toll, Investigations. Table 1 also presents 7 
wh W-up findings of the same group of me 
ose IQs were obtained in childhood. The 
oe are summarized in scatterplot form ya 
cages to make them comparable to Wolfe's 
l) categories of educational achievement. 
a appears that the IQ has considerab'e 
pa ot Predicting scholastic achievemé : 
~cularly in the tails of the distribution © 
ie ompared to the controls and the ee 
ie Ever, the lower end of the IQ range \ 
of “ah defectives) , reveals greater sem 4 
achie ediction for the criterion scholas 
levement. | 
xi the upper extreme, the gifted's aE 
= y educationally is self-evident i 
aduateq from college). According to e 
ra and Oden, none of the gifted failed 2 
up plete grade school. For the middle an 
r range of the predictor, however, = 
ig Puted percentages, placed in their eas 
a Cells, Suggest the characteristic varia? we! 
Served before and again reveal the twis 
ĉar shape. : 
a hat about learning, personality, and the 
Wisted pear” phenomenon? In his genetic 
catch of dull-bright rats and ones carts 
nity, Tryon (1940) found that while a 
Sr Maze-learning of the dull rats could : 
p edicted very well, the bright rats soe 
Oughout a wide range of learning Z 
ot rs). Table 2 presents a fourfold ke 
vhich was obtained by plotting around the 
ian value of the total errors of the sev- 
rath generation (N = 153), the total errors 
made by their dull and bright offspring of 
n Sth to 18th generation. The reason for 
Sing the seventh generation as the source for 
À € median value comes from Tryon’s ob- 
‘tvation, “There appears to be a law of di- 
‘ishing returns, for after the F; negligible 
“ects of selective breeding are noted.” None 


Tooo Ay 


403 


Table 2 


ight and Dull Strains 15th-18th 
Bice Sg Who Fall Above and Below the 
Median Total Errors of the 7th 
Generation (N = 153) 
(From Tryon, 1940) 


Brights 30 70 
(N = 332) ‘ 
e 
S 5 
= _ 
E Si 
s © 
e = 
E 
Dulls 100 E 0 
(N = 130) E 
| 
(ees See ee 
— 203 —39 =—§ 


Total Errors 
Criterion 


of the descendants of the dulls fell in the 
bright category, whereas 30% of the descend- 
ants of the bright ancestors performed in the 
dull category. The results, in short, suggest 
that the relation between predictor ancestors 
and criterion descendants, involving the learn- 
ing of a complex set of highly integrated acts, 
is that of the twisted pear. 

The work of the California-Berkeley group 
on authoritarianism suggests a similar pattern 
of differential predictability in personality as- 
sessment (Adorno, Frenkel-Brunswik, Levin- 
son, & Sanford, 1950). While high scorers 
(authoritarians) and low scorers (nonauthori- 
tarians) “emerge as a result of statistical 
analysis . . . they consist in accumulations of 
symptoms frequently found together but they 
leave plenty of room for variations of specific 
features. Furthermore, various distinct sub- 
types are found within each of the two major 
portions.” Analysis of the prejudiced subjects, 
however, revealed that they are “on the whole 
more alike as a group than are th 
diced. The latter include a great variety of 
personalities . . .” (pp. 971-972). It seems, 
therefore, that a high score on the ethnocen- 
trism scale is more predictive of authoritari- 
anism than are low scores of its absence. 

Leaving psychology for a moment, an ana- 
logue seems to exist in the actuarial determi- 


e unpreju- 
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nations of the life insurance field (see Fig. 1). 
For example, having reviewed their experi- 
ence tables and having ascertained the extent 
of their errors of Prediction, insurance com- 
panies confidently relate obesity to a short 
span of life and set their premium rates ac- 
cordingly. As weight approaches nonobesity, 
however, there appears to be increasing vari- 
ability in predicting life expectancy. It is, of 
course, true that no one dies of obesity and 
the nonobese may die of many other causes: 
yet as a predictor variable of the probability 
of life expectancy, insurance companies re- 
spect the highly significant relationship found 
at the “poor”-nonadaptive extreme, i.e., þe- 
tween obesity and short life expectancy. 

In their daily practice, my hospital medical 
colleagues confirm the curvilinear relati 
tests and their cri 
thology; at least, they acknowled 
the application of differential 


ing (“poor” 
able respect. The reason fi 
diagnostic techniques 
80% of the time whe 
finding, i.e., the false 
negative or even a bor 
to average score) how 
regarded 
finding is 


n ratios of the 
predictor classes Vie Nops -Yn on the Criterion 


X, is to attenuate the validi 
the product-moment > is c 
drawing the Scatterplot, the 
not be heteroscedastic, and the analyst can- 
not tell whether there are differentia] Predic- 
tions of the various Y Classes, 


Jerome 


Fisher 


Guilford (1956), among others, bas ane 
for the importance of scattergram ISP! “tae 
With respect to organismic ae equal 
fore, the case of linear association an t not 
variance obtains and applies partially, hee 
throughout a predictor-criterion isl af 
The case of curvilinear association ee i 
equal variance, however, also MT reser 
therefore, both cases are relevant and 
our differential appreciation. and in 

Tt has been said many times before ‘of t 
many different ways that the behave. marn 
adaptive, functioning organism is or ‘this a 
highly complex. I think we mean DY ensa” 
Capacity for variable, substitutive, cage i 
tory behaviors. Under the disupa it i$ 
tions of pathology or stress, for examp. rovi 
as if special homeostatic mechanisms Teen 0 
a biologic and/or psychologic smoke ae proc 
adaptiveness, These on-going, Leagenyt ig 
esses may be largely responsible for t atives: 
rate of “normal” responses or false me out 
It is perhaps no accident that many en de 
Most useful diagnostic methods have be w 
vised to assess pathology in status; a e, 
the camouflage is no longer impenetra tai ed < 
when adaptiveness has been or is se here: 
beyond a certain point. I am paneer 
in particular, to Binet’s original menta ~ 
an extraordinarily fine screening dev non 
mental deficiency.* Tt is precisely in t ictor® 
adaptive segment, then, that our er theif 
Seem to prove themselves by virtue te con 
high rate of predictive accuracy. In se the 
nection, it should be pointed out ann i 
are not entirely without predictive par ative 
the adaptive segment either, albeit i a 
errors lessen their accuracy. It seems, extra 
fore, that when predictor measures ate from 
polated beyond that “certain point,” vonaplex 
“poor” to “good,” the multivariable comf a 
ties of behavior multiply and interfere W 
our predictive accuracy. Hence, it ae 
that whatever validity a measure may’ Pite 
for predicting adaptive behavior, it is 


=. 


f 
ept 0 
8 Recently, Jones (1958) advanced the onei y 
polarity to explain the one-ended conceptua' ethod 
of most psychologic scales. He proposes a ™ pot 
for testing interitem homogeneity at cither ar scale 
ends of a continuum to determine the degree 0: 

polarity. 
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to 
oe accurate in predicting nonadaptive 
B 
a S dden determinant in all this 
e nonada T imension itself extending from 
pears to iS ive to the adaptive- It, too, ap- 
and “truth ave a partial range of certainty 
about the. at a because more is known 
a aens: tan criterion points of non- 
avior, Our A an about those of adaptive be- 
ide us with est construction procedures pro- 
Measures of reasonably good techniques and 
» howeve criterion nonadaptive behavior. 
Ossesses th , the twisted pear phenomenon 
Y the » Sg degree of generality suggested 
9 question 1 reviewed, then, there is reason 
ftom the the assumptions for extrapolating 
tremes of nonadaptive to the adaptive ex- 
sS it predictor-criterion relationships. _ 
Ci Ea oe that the observed partial 
Ce ate ity and differential predictive vati- 
tests) e ge artifacts of sampling (of our 
e AR our criterion determinations? Is 
non, or i | pear solely a “clinical” phenome- 
the pr ìs it a more general characteristic of 
tions Lie problem? Perhaps these ques- 
Petha e unanswerable at the present time or 
“PS we are dealing with a reality of or- 


Banismi 
d ic behavior, one of the existentional 
from Erich 


Ue 

Biom to borrow a term 3 

if, on Nd the behavioral sciences. Tt is as 

ance "ye one hand, there is general accept- 
of the dynamic nature of organismic 


adaptat: sm 
then tation and change, and the variability 
4 f ther hand 

o ? 


they induced, while, on the 
Vali dite the coexisting pursuit of immutable 
Y coefficients as an attainable goal in 
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the business of understanding and predicting 
behavior. 


Received August 11, 1958. 
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FACTOR ANALYSES OF RORSCHACH SCORING 
CATEGORIES AND FIRST RESPONSE 
TIMES IN NORMALS: 


JULIUS WISHNER 
University of Pennsylvania 


The Scoring Categories 


The present studies were undertaken and 
completed prior to the appearance of the fac- 
tor analyses by Williams and Lawrence (1953, 
1954) and Consalvi and Canter (1957). The 
study by Borgatta and Eschenbach (1955) in 
particular raises serious questions as to the 
predictability of overt behavior from the Ror- 
schach test, as does the experiment of Holtz- 
man and Sells (1954), Nevertheless, the Ror- 
schach test continues to be used in the clini- 
cal setting, and there is continued interest in 
research results, 

Opportunity to check on Wi 
(1950a) results of his factor analysis of the 
Rorschach Scoring categories, taking advan- 
tage of suggestions stemming from Cronbach’s 
(1949) critique of Statistical procedures uti- 
lized by Rorschach researchers, was provided 
by the Rorschach data coll 


ttenborn’s 


ia for its 
Preciation is also 


and Howard Maher for 
helpful suggestions and consultation, 


financial support of this Project. Ap 


| 
| 


also been reported by Sen (1950), Fiske a 
Baughman (1953), Borgatta and Eschen 
(1955), and Wittenborn (1950a). aa 
From the point of view of populatie 
studied, Wittenborn’s Yale undergradv 
are the only nonpsychiatric subjects W e 
Rorschachs have been factor-analyzed. tric 
present study deals with a nonpsy china 
population, less selected than Yale aipa 
graduates, representing four general p 
tional groups: executives and junior a unr 
tives, skilled workers, semiskilled, i al., 
skilled as reported elsewhere (Bere i by 
1950). While the population studie also 
Eschenbach and Borgatta (1955) was per 
ostensibly normal, it did include military ches 
sonnel who had been incarcerated for me i 
of discipline; in addition, their populata 
general, can be presumed to be as sê nne 
as the Air Force js in selecting its Se 
From the standpoint of scoring an ay i 
putational procedures, the present E 
most like those of Eschenbach and P eoplem 
(1955). They dealt with the general P atl 
of the dependence of the absolute E 
responses in any particular scoring Ca y 
on the total number of responses tudy: 
means of partial correlation. In this aA 
the scores were converted into perce bighll 
Since many of the distributions were f the 
skewed, Scattergrams were constructed kewe 
relationship between the most highly S ade: 
variables, and tests of linearity were E, 
Significant nonlinearity was found in one 
and this is discussed below. 


ns 
es | 


n 

Computational Procedures, Results, and I 
terpretation of Factors o 
The population is described in detail 

Beck et al. (1950). There were 71 males a” 
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Factor Analyses of the Rorschach in Normals 


Table 1 
Rorschach Scoring Categories Analyzed 


Variable 
No. 


R 
W% 
D% 
Di% 
M% 
C ECI% 
“(C+ CF + FO)% 
FC% 
- Sum C/R 
WV + FF + FY)% 
~VAVFAEVY)% : 
I a 
14. PE 
15. HY 
16. AG 
- N/R (N = The number of content 
Categories utilized by the subject) 
Z/R 


SENDEN H 


19, PY, 
T/R (Time per response) 


: . 
a females; the age range was 17 to 69, with 
wean of 30.5 and an SD of 8.55. There 
9 executives and junior executives, 47 
> Workers, 44 semiskilled, and, 24 un- 
- The subjects (Ss) were administered 
Fisk Orschach by two different Cente 
ere CDd Baughman (1953) report that theri 
~ 00 systematic differences between the ex- 
An Pers in total number of responses aici 
the that each tested the same proportion © 
our vocational groups. ‘cs 
te i Scoring categories chosen for ana Fa 
the OWN in Table 1. It will be seen that, r 
Sch, Most part, these are the standard 5 a 
The Scoring categories as used by Bec*: 
> Y, and V scores were broken up as 
CY are in order to test again Wittenborn s 
dif ings that FC has a factorial composition 
Bia from C and CF, to test the more 
th ‘tal implication of his findings concerning 
impo minance of F, and to test the assertion 
Plied by the scoring system that Y and 4 

resent different psychological qualities. 

thes e product-moment intercorrelations of 
Tabh, Scores were computed and are shown in 
APplie 2. Blakeman’s tests of linearity were 
ge lied to 12 comparisons involving the most 
ewed distributions, and yielded significant 
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nonlinearity only between H% and P%. How- 
ever, since r of H% and P% is —.04, whereas 
7 is only .33, and since inspection of scatter- 
grams indicated no obvious curvilinearity in 
the other comparisons, it did not seem neces- 
sary to resort to transformations. 

These intercorrelations were then factor- 
analyzed by the centroid method, and the re- 
sults are shown in Table 3. As in most factor 
analyses of the Rorschach test, four factors 
emerge. f 

Attempts to rotate these factors according 
to Thurstone’s criteria of simple structure did 
not meet with success. Plots of the factors 
against each other revealed that in most cases 
there was an approximately equal distribution 
of the tests in the four quadrants. Thus, there 
seemed to be no objective bases for preferring 
one rotation over another. 

It was decided, therefore, to make direct 
tests of the hypotheses underlying this study, 
as well as tests of general Rorschach hypothe- 
ses. These hypotheses were: 


1. That there is a factor of psychological 
efficiency ; : a 

2. That the factorial composition of FC is 
different from that of C and CF; 

3. That there is a factor of verbal produc- 
tivity. 
The fourth hypothesis, added after the first 
three had been tested, was: 


4. That there is a factor of compulsivity. 


The procedure utilized in testing these hy- 
potheses consisted of setting down the scores 
which are supposed to reflect the factor in- 
volved, choosing the central score of this com- 
plex, rotating the factors so that the loading 
on this central score is maximized, noting the 
loadings on the other scores, and then esti- 
mating the degree of agreement with the origi- 
nal hypothesis. For example, in order to test 
the hypothesis that a factor of psychological 
efficiency is identifiable in the Rorschach the 
factors were rotated through F%, since ‘in a 
previous study it was found that F % showed 
the highest coefficients of correlation with 
general alertness (Wishner, 1953). It was hy- 
pothesized that the factor would have Tope 
ings in F%, T/R, and A%, 


nificant loadings of the en as well as sig- 


te sign in M%, 


80F 


Table 2 


Intercorrelations of Rorschach Scoring Categories 
14 15 16 17 18 19 


122 132 —.132 —.014 —.011 194 289 
‘1H 108 


Variable 7 3 
No. 1 2 3 4 2 6 7 8 9 w w v g 
2. =.332 
3. 120 —.811 
4. 409 —.609 —.043 
5. 166 012.029 —.027 8 
6.  —.004 434 —.247 —.396 046 S 
7-007 467 —.257 —.426 023 885 = 
8. =—.030 253 —.128 —.256 —.018 167.599 
9, —010 459 —.253 —.420 044 964 951 370 x 
10. 293 256 EA 

Š 

SE 


11 .177 .068 —.106 .066 .132 .155 .087 —.091 

12. 194 .136 —.169 .031 .076 .237 .263 .161 .272 .801 .685 

13. —.192 —.288 162 .220 —.551 —.606 —.679 —.429 —.661 —.539 .087 —.650 

14 —.251 159 0 —.298 O71 108 142 133 145 151 185 = 224 —.224 

15 208 —.226 .081 305 .746 —.241 —.269 —.170 —.256 —.067 —.002 —.059 —.183 .057 

16. —.424 —.065 .155 —.150 —.34 —.241 —.207 —.010 —.232 —.246 —.311 —.367 467  .081 —.270 

17. —.345 357 —.240 —.263 —.186 331 307 .101 .326 .227 .039 .196 —.179 064 —.334 —.298 

18. —.217 .787 —.581 —.473 .254 446 496 .298 469 .138 157 .196 —.477 .232 —.048 —.221 363 

19. —.515 .206 —.011 —.342 —.008 —.127 —.093 .048 —.111 —.166 —.288 —.294 198 449 016 .386 083 115 

20. —.470 117 —.110 —.035 —.104 —.255 —.290 —.186 —.283 —.174 —.168 —.231 .337 —.022 —.053 449 —.018 —.054 .254 


Factor 


Table 3 


Unrotated Factor Loadings—Scoring Categories 


= ee ohana 

Variable 
3 lil IV I? 

—.3505 3627 6417 

a 3005 -7027 

—.1391 —.2901 3520 

—.1359 —.1362 5476 

A091 4561 -6709 

— 4029 2011 .7446 

— 4939 2350 1 0199 

—.2274 0509 .2556 

— A624 2092 9317 

—.2741 — 3436 5986 

2264 —-2959 5007 

—.1481 — 4301 .8892 

3261 —-2909 1.1012 

3170 —-3180 4255 

A750 3947 6738 

1914 —.2561 4657 

—.2495 —.1099 2129 

A721 3000 6622 

4304 — 1991 A401 

3544 —.1533 -3094 

| ——— —— 

ag and V. The reader will recognize (a 

(osa of this procedure to Eysencs S 


method of criterion analysis. = 
in T € final rotated factor loadings are $ iow 
„able 4, With respect to the first hypo = 
log. 2ctor Il’ is the one rotated so ibat ie 
hy ngs on F% would be maximized. k 
ang esis required that the loadings ai, ie 
th A% be of the same sign as F7 anc al 
a loadings on M, C, Y, and V be of oppos e 
ns. f we adopt a convention of consider ng 
'y factor loadings of .35 or higher 1m or! er 
€al with at least 10% of the gain F 
R, the requirements of the hypot = 
a to be met. This factor resembles ae n 
yet as representing perceptual con = 
4 Wittenborn (cf. Factor B in 1950b). a 
th interpretation is perhaps closer to the data 
i An the one offered here. At the same Hima 
is interesting that the Rorschach can yie 3 
actor predicted on the basis of a view ° 
in chological efficiency as the central concept 
mental health (Wishner, 1955). l 
Sychologically, this factor seems to reflec! 
Continuum ranging from sensitivity to vari- 

i of nuances of the Rorschach cards (loadings 
eq c& Same sign on M, C, Y and V, and F+) 
°nforming to content most frequently re- 
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ported (F+), at one end, to deliberate (T/R) 
and relatively exclusive meen to to 
(Fo) with animal content (4%), at the 
other end. At a higher level of Anger 
one might interpret this as flexibility—rigi oh 
Taking into account previously penp 
relationships with physiological variab es, 1 
does not seem too farfetched, even if el 
what speculative, to suppose that perzspni - 
flexibility-with-control may be the centra ba- 
sis for motor efficiency (Wishner: 1953, 1955). 
However speculative, it is still true that it was 
just this notion a“ led to the prediction 
z confirmed. 
oad to Hypothesis 2 concerning 
the factorial composition of C, FC, and M : 
rotations were made of Factors T’ and mt, I 
and IV, and III and IV so pd to maximize 
both M and FC alternately. None of these 
rotations produced a meaningful factor. It can 
be seen by an inspection of Table 4 that M 
and FC do not have the same factorial com- 
position, as shown by the fact that they do 
not have significant loadings on the same fac- 
tors, and indeed, they have loadings of op- 
posite signs on two of the factors in the cen- 
troid analysis, and on one of the factors in 
the rotated analysis. At the same time, the 


Table 4 


Rotated Factor Loadings—Scoring Categories 


Variable 


se w wO m ë wv e 
1 —.6825 —.0207 0012 4181 6410 
z 7373 —.2606 1603 2544 `7019 
3. = 4149 3055 —.1856 — 2278 3818 
4o =.6611 3021 00795 1113 “S470 
5 = —.2228 —.4369 6360 1504 “6704 
A 3594 —.5727 —.3293 4224 “7440 
7 4172 —.6527 — 4047 15030 1.0180 
a 2305 —.3429 —.2227 “ig74 2554 
9. 3983 —.6384 — 3859 464419308 
10.  —.1503 —.6298 — 3850 —1740 “soga 
11. = 1281 — 5726 0788 — 3872 “S004 
12. —.2724 — 7884 — 2921 _ 3280 8887 
13. 0616 9536 1320 — 4121 11004 
i4. 3190 —.3989 0589 —.4012 4253 
15.  —.3794 —.2070 16953 0544 “6732 
16. 3522 5123 —.0284 —.2793 “4653 
17. 2953 —.0909 —.3358 0669 2127 
18. 5663 —.4987 11806 2370 “6615 
19. -5366 10581754 — 3312 “4306 
20. 30733250 1768 — 2791 “3002 
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i osition of FC seems very simi- 

at tid CCF, C+CF+FC, and Sum C/R. 
Thus, this aspect of TA ROR results is 
firmed in this study. : 

P With respect to Hypothesis 3, Factors I 
and III and Factors I’ and IV were rotated 
through Dd%, and this yielded Factor I 
which appears to be meaningful. The by- 
pothesis required that there be high loadings 
on Dd%, M%, and C. This is seen, except 
that the loading on M% is not notably high. 
It is difficult, however, to exclude the possi- 
bility of artifact in that this may again rep- 
resent some part of the productivity factor. 
Thus, for example, there is high loading on 
R, V, and N, as well as on the other loca- 

tional variables. 

The final rotation was an attempt to repro- 
duce the productivity factor by rotating Fac- 
tor IV against III’ through R. The produc- 
tivity factor required that R, W, and Z have 
high loadings of the same sign, with A of op- 
posite sign, based on the relationships with 
various subtests of the Wechsler-Bellevue 
found previously (Wishner, 1948). While this 
general pattern is seen in Factor IV’, the 
loadings do not appear high enough to war- 


rant its interpretation as an intelligence fac- 
tor; indeed, Factor I” 


appears to fit the bill 
better. Thus, one might view both Factors I” 
and IV’ as productivity 


factors, but having 
different Psychological bases. Factor 1” may 
reflect productivity based on unusual 
Mentations of the blo 


Rorschach. 

Factor III” remains to be interpreted, It 
has significant loadings on M and H, and 
loadings of opposite sign on C, Y, and per- 
haps NV. This would appear to indicate a 
tendency for individuals to Predominate in 
one or the other, although 


h there is no di- 
rectly inverse correlation between M and C 


Julius Wishner 


(see Table 1). In view of previously ambia 
ous findings in this sphere, it is unclear 


4 ay 
psychological significance this factor ™ 
have. 


Discussion 


The results are not unlike those oi 
previously, although a wholly different Pa 
lation from those in other studies was u shave 
Almost all investigators since Wittenbo ae 
found that the Rorschach yields four i 
Similarly, they have found a factor var 


7 igencê, | 
labeled as productivity, verbal intellige?” 


etc., while the other factors have Prov chet” 
biguous. The most thorough study by the in 
bach and Borgatta (1955) indicates diction 
adequacy of the Rorschach in the p” 
of overt behavior. is 
In all these respects, the present a 
confirmatory, or at least not contra þorn’ 
There is a failure to confirm wit of 
finding of similar factorial composition? -id 
FC and M, which are different from e bes 
CF; of course, no correlation with © 
havior was attempted. rs to be 
On the positive side, there appe® ical eft 
Confirmation of a factor of psychologi mental 
ciency which would be related to reviow® 
health and illness as suggested in nical 
Papers (Wishner: 1953, 1955). a cone 
after all, the Rorschach may well da ill 
ceived as having the estimate of rate ach’ 
ness as its major function, despite Ro ave any” 
original denial that his test should a hus: 
thing to do with psychiatric diagnosi us SU% 
this confirmatory finding of a prev pai iga 
gestion may be worthy of further in 
tion. -cates A 
The #* column of Table 4 indict RCo 
the greater part of the variance of ee u 
F+, AJo, N/R, Pf, and T/R is 
counted for by these factors. The fi tenti! 
of these have received extensive al n cli 
both in the Rorschach literature and } as 120 
cal work, but their significance, insofar pt. OF 
tor analyses can reveal it, seems in dou yari 
the other hand, more than 70% of De er 
ance of W%, C treated indifferently 4 
tween CF and FC, V+V, and F% S gine 
counted for. F% and the color and sharaces 
determinants may be conceived as twO f the 
of the same coin. In general, the sign © 


+ 
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ae pens of F% are the opposite of 
guaranteed | V, and C. This is practically 
igh Ch, a4 the scoring procedures, since 
limit bn 9 %, and V% necessarily places a 
as a score Ye, It appears, therefore, that F Jo 
much gr reflecting perceptual control merits 
Ceives pate r attention than it generally re- 
fan Pe Particularly in the light of the concep- 
is i r chological health here proposed. It 
of Mo ting that some 67% of the variance 
M% te ri accounted for and that F% and 
ions, a to have similar factorial compost- 
Particu] eel of past research on M (see 
1956. at ly Singer, Wilensky, & McGraven, 
oz & Spohn, 1954; Williams & 
i Dog Wittenborn, 1950b) this 
Offered mia to the interpretation of F% 
composi ere. At the same time, the factorial 
A ae of W% seems independent of 
may merit further attention as @ 


Possible ind; 
trait, e indicator of a significant personality 


‘ . 
To pene recognized, of course, that fail- 

Uni Chieve simple structure implies a lack 
a Ae mee to the set of rotated factors 
ations z r interpretation. Certainly, other ro- 
een S other hypotheses would have 
| Solution ssible. At the same time, Š 
| pre 1S not arbitrary, and rests on a body 

Vious research on the Rorschach and 


a 
Spects of personality theory- 


First Response Times 


i mate first response times recorded for Beck's 
St re were also factor-analyzed. In addition, 
Corre], Sponse times in the Rorschach test were 
estali e with response times to the Street 
Teactio Completion Test (1931) and visual 
Sults a times, studies suggested by the re- 
tevi the factor analysis. : 
nae research on response times in the 
Concer ach test has raised serious questions 
“tolo ning the tenability of such concepts âs 
tovne Shock,” and “shading shock” (Dub- 
T Von Lackum, & Jost, 1950; Lazarus, 
ande Matarazzo & Mensh, 1952; Rabin & 
been ison, 1947; Siipola, 1950). There has 
time nie positive suggestion that reaction 
objectis the cards may be a function of the 
Mat ve difficulty of each of the cards 
ee & Mensh, 1952; Meer, 1955; 
n & Sanderson, 1947). A search of ite 


aLL 
Table 5 
Intercorrelations of First Response Times 
to the Rorschach Cards 
(Decimals omitted) 
pnn — — == 
Card 
No No: 1 2 3 xs © 7 Sg 
2. 26 
3. 30 483 
4. 27 34 48 
5. 10 35 34 32 
6. 37 23 30 29 10 
f 28 49 44 37 19 54 
8. 46 33 27 37 13 52 31 
9. 1s 41 38 46 17 40 34 53 
10. 20 29 40 32 26 41 42 34 29 


literature fails to reveal any previous factor 
analysis of first response times in the Ror- 
schach test. 

The object of this part of the study was to 
determine the number of factors necessary to 
account for the intercorrelations among first 
response times and to ascertain whether any 
such factors could be identified as difficulty 
or shock factors as had been suggested previ- 
ously. 


Procedures and Results 


The raw data were the first response times 
to each of the ten Rorschach cards obtained 
from the sample described above, and the 
product-moment correlation coefficients among 
these are shown in Table 5. The results of 
the centroid analysis yielding two factors are 
shown in Table 6.* Although the centroid 
solution is arbitrary, a plot of the factors 
shown in Table 6 reveals immediately that 
while the structure might be simplified slight] 
by a small clockwise rotation of Factor I 
(10-15 degrees), the essential nature of the 
factors could not be altered by any sensibl 
rotation. It was decided, therefore, to nae 
the centroid analysis as the fin 1 luti 
without rotation. Se 

Since there are relati i i 
all cards, it is ii: Bet me 
some general factor of individ a aie ees 
in response time. Factor II is eat 5 iy diffi. 
cult to interpret. It has probabl ome! oF 

ably significant 


2For the major portion of this part of the sta. 


tistical work, the ee, 
Downing. author is indebted to Robert 
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Table 6 


Centroid Factor Loadings—First Response Times 


i 48 =p 28 
2 61 22 42 
3. 64 .29 49 
1 62 09 30 
5. 30 35 27 
6. ‘62 —.25 45 
7, 66 10 45 
8. 64 ~ 46 62 
9. -62 —.12 40 
10. 56 08 32 


loadings of opposite si 
but no immediately sı 
suggested, si 
any uniquel 
which is ph 
been suggested in the literature, 
i ors derived cannot 
account for much more than 50% of the vari- 
ance of response times to these cards, 

If Factor I is interpreted as a general 


factor, the problem arises whether it Teflects 


es to inkblots, 


The Relationship Between 
Times on the Rorschach, 
ime, and Response Time 
stalt Completion Cards * 
Thirty male college students 


schach test, 
stalt test, and a Verni 


First Response 
Visual Reaction 
s to Street Ge- 


were tested by 
the Street Ge- 


cards were then given 
with the Same instruc- 
3 The writer is indebted to Willi 


l tam Rosenblith who 
aided in the collection of these data, 


to the S one at a time, 


Julius Wishner 


i.e. 
tions as used for the Street Gault ke 
to give a response as quickly ae actin 
ing the whole inkblot into consi A an- 
S was not told that there were no ught that 
swers in this test, since it was eat = Jess 
this would make the situation eee 
comparable to the Street Gestal) A 

Finally, 10 readings on a beers time. 
scope were made of the S’s reac d told him 
shielded his key from S’s view an dy signal, 
to watch E’s pendulum. After a rea Ye a5 
the S was to release his pendulum a A 
he saw the other pendulum move. 
for speed was stressed. ks, it was 

Through the use of these a a coll 
hoped to compare the emg a wit 
ceptually oriented task, as well a jf ther 
visual-motor reaction time. oy tector’ in 
Were some general response spee: should 3 
volving Conceptual activity, there Rorschae 
Significant correlations between the were 


i actor ere 
and Street tests; if the general Í es 


ion times," 
Confined to sensory-motor reaction io 
should þ 


; a 
e a correlation with peor se p 
times; or, of course, the compar Ee task® 
yield intercorrelations among all ma factor 
indicating a very general response 


Results 


chrono 


et ca" 

Mean response times to the a rho oi 
and to the Rorschach cards ge and 
+.23; the rho between reaction p pete 
Street Gestalt cards was —.03. Rh d reactor 
each of the 10 Rorschach cards x street c 
time, and between each of the acide no 
stalt cards and reaction time, yie fore, P% 
nificant coefficients. It is clear, m tim a 
no such general factor as a en accou 
response time can be hypothesize eat i ie 
for the general factor found in resp noted, ©, 
to the Rorschach test. Tt must Be ite i 
Course, that the experimental proc s on the 
lized with respect to response fe ocedure? 
Rorschach was unlike the clinical pr as they 
yet the instructions chosen, ae ene 7 
Were more homologous with the proc estal 
the visual reaction time and Street per i” 
experiments, should have favored E stot I, 
tercorrelations among these tests. + mo 
therefore, appears to represent a aee aie f- 
specifically related to inkblots and t 
fect on response times, 


wee” 


eed | 


ie 
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Summary 


A matrix of intercorrelations of the scores 
rn 157 Rorschach protocols originally col- 
feted from a stratified normal sample by 
peck et al, (1950) was factor-analyzed. The 
Ypotheses tested were: 1. That there is a 
met Psychological efficiency; 2. That the 
actoria] composition of FC is different from 
t of C and CF; 3. That there is a factor 
fa verbal productivity; 4. That there 1s : 
Ctor of compulsivity. Support was adduce 
a Hypotheses 1 and 4; Hypothesis 3 also 
ems tenable, but with less confidence; Hy- 
ienesis 2 is not confirmed. Perceptual con- 
1S reflected in F% and M%, seemed to 
the Most important variable involved $ 
Ro conception of psychological health on the 
Orschach test. 
factor analysis of the intercorrelations 


th i 10 cards 
of the the first response times to the 


Of generality, 30 subjects were given the 
vetschach and "Street Gestalt tests, aS 
Creo, action time task. No significan oe 
thon telations were found. It was conclu 
te refore, that the general factor seen 1M 1 
‘Ponse times of the Rorschach test cann 
ti conceptualized as a generalized aa 
cife t5, but is probably related mies pe 
9 ically to inkblots and their specific € 


response times. 


Ce}. 
“Ved August 11, 1958. 
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SOME MANIFEST CHARACTERISTICS OF 
RECALLERS AND NONRECALLERS 
OF DREAMS 


ROSALEA A. SCHONBAR 
Teachers College, Columbia University 


Dreaming, most psychologists agree, is a 
universal experience. Research with electri- 
cally recorded eye movements during sleep 
led Dement and Kleitman (1957) to conclude 
that “periods of . . . dreaming . . . are an 
intrinsic part of normal sleep” (p. 345), and 
that all people dream several times a night. 

Although it is likely that everyone dreams, 
many people report that they do not. The 
fact, then, that many persons have little or 
no recall of dreams raises interesting 
tions. What are the distinguishing ch 
istics of persons who do, 
that they dream? 


The present research was undertaken to 
examine some correlates of dream recall. Some 
hypotheses were drawn from Ramsey’s ( 1953) 
review of the literature on dreaming—that 
frequent recallers of dreams are younger, 
more intelligent, and more often women than 
men. Other hypotheses were derived from 
psychoanalytic theories (Fromm, 1951; Had- 
field, 1954) which hold that the dream makes 
possible an internal communication prohibited 
during Consciousness because of the anxiety 
it would evoke. Two alternative Propositions 
were put to test: that manifest anxiety is posi- 
tively related to the recalling of dreams, or 
that nonrecallers and frequent recallers are 
both more anxious than a less extreme group. 

The informal observation that many psy- 
choanalytic patients become Progressively bet- 
ter able to remember dreams leads to the fol- 
lowing question: to what extent is this be- 
cause remembering is “the thing to do” under 
the circumstances, and to what extent because 
it implements their motivated search for self 
awareness? Manifest needs w 


ere selected from 
those defined by Edwards (1954), and the 


ques- 
aracter- 
or do not, report 


ity ÍS 
following predictions made. If contra 
the determining factor, then people W. oe 
dreams when it is asked for or ape needs 
them might be expected to have high ©, 


* cte! 
dream recall, recallers might be CP AN 
have high needs for endurance, intr 
and succorance, 


Procedure 


uid- 

The Ss were 42 teachers and school a is 
ance counselors who were students a coun 
week graduate summer course in pare Negt? 
seling. There were 15 white women, 1: on coll 
women, and 14 white men. Informa eat 
cerning age was collected in terms of e rang? 
intervals; taking midpoints, the ag ean a 
Was from 22 to 52 years, with the a diffe" 
33.8 years. Men and women did ve of the 
significantly in age, but only 32% ontrast 
women were or had been married, in © 
to 62% of the men. 

ee first day of class a persom™ taine 
form was distributed. These sheets rine onl 
code numbers, which were thereafter for the 
identifications on material submitted pooklet 
study. Each S$ was given a printed and 28 
containing a detailed instruction sheet 
erforated pages. 
5 The meN stated that one pase con 
to be submitted each day for 28 days: "oes 
taining a record of all dreams or expe’ eding 
of dreaming while asleep during the pre“ eams 
24 hours. Ss were told to write the dr rui- 
as completely as possible, including incon ey 
ties, vague impressions, and the like; 


; j 
were told how to report associations or Cla! 


1 daté 


was 
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7 of Dreams 
Recallers and Nonrecallers Í 


cations so as not to contaminate the dream 
report itself. Feelings during and after the 
Team were to be recorded; Ss were also in- 
structed to indicate whether the dream oc- 
curred while falling asleep, at an indetermi- 
vate time, or just before waking, or if it woke 
them during the night. Dreams were to be 
Written immediately upon waking in the morn- 
"38, or on waking from a nap.* 

ch report sheet contained a short re- 
minder of some of the more important mm- 


‘ ip uctions, The rest of the page was blank so 


at the dream could be recorded. At the bo“ 
m of each sheet Ss could check, if bean 
Pate, “No dreams in this interval,” “Aware 
a having had dream but can’t remember 1I 
tent,” or “Above (recorded dream) aS h 
“member, but I know there was more. ee 
Submitted a page every day. In tabua E 
a S was credited with having remensber*t f 
ream if he could remember any ieme a 
content, Although some Ss reported more yrs 
one dream during a single report pertad, aa 
fluency of recall was defined for this stu A or 
number of report periods in which on 
Ote dreams were recalled. riment 
th uring the second week of the “K chedule 
© Edwards Personal Preference SC te at 
goss was given to the Ss to comp EAT 
ame. Early in the fourth week e 20-word 
nxiety Scale (Cattell, 1957) and a re ad- 
sabulary test (Thorndike, 1942) Va is an 
Ministered in class. Briefly, the Po for 
ventory of paired statements, cea choice 
Socia] acceptability, in which the force h E 
scores correspond to a need system a ce 
i work of H. A. Murray. The IPA don 
let cale is a 40-item questionnaire B Si 
-tor analysis of a number of measure d 91 
Yielding split-half reliabilities of 84 an have 
ifferent populations; validity are 1 
5o yielded positive results. The mu ‘ihe 
Choice Vocabulary test was derived from 


si Jates ' 
Intelligence Scale CAVD; it correla 


i ong a 
em vith a general intelligence factor anne 2 
Sample of adult males (Thorndike, Sp iE 
Mori, 1952) and .62 with the 191 
ited 
«The detailed inst uction sheet has been deposi 
With the American peainentation Institute. Order 


icrofilm, 
op cument No. 6015, remitting $1.25 for microhim, 
$1.25 for photocopies. 
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administered to hospital patients (Miner, 
1952). 


Results 


1176 reports were collected, of 
hich a contained dreams. oe eae 
dividual recall a, Li ac Re 

uency why 
days; e half the Ss recalled 
(heen only 14% of the time or = ps 
: nly once or not a : 
7 Asan Nearer Thirteen of 
E e dreams 25% of the time o 
ad - these constitute the Recallers. The Re- 
ie nsisted of four men and nine women, 
eE i four were Negroes; the Nonrecallers 
Ta five men and ten women, of whom 
co 
a eee E oie mean frequency of dream 
“al for men was 4.57, and for yon 5.39; 
‘le in the predicted direction, the difference 
Las ae by ¢ test) was not significant. The 
e tbe Negro women was 5.0, for white 
eet 5.73, a nonsignificant difference. There 
Leen sex difference in the constituency of 
i i standard deviations of the 
EE and Nonrecallers were computed 
ll variables; the differences between the 
a S means were measured by ż tests. 
E 1. presents these data. When a differ- 
ence was significant, the point biserial cor- 
relation is also presented to indicate the de- 
gree of relationship between the variable and 
dream recall. All oo are for the two 
K e groups only. 
ae rs ina ifesi needs. As Table 1 re- 
veals, age is not related to frequency of dream 
recall. Of the manifest needs, the only signifi- 
cant difference was for succorance; five of the 
other six hypothesized differences were in the 
predicted direction, but were insignificant. It 
seems most economical to conclude that the 
difference in succorance was a chance finding, 
and that there is no relationship between these 
needs as tested and recalling or not recalling 
dreams. 
Intelligence and manifest anxiety. Table 1 
reveals that Recallers were significantly higher 


than Nonrecallers both in intelligence and in 
anxiety. The mean anxiety score of the middle 
group (V = 


14) in dream recall was 27.07, 


Rosalea A. Schonbar 
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Table 1 
; r, Manifest Needs, 
i Between Recallers and Nonrecallers in Age, Vocabulary, Mani 
Megusl itierenses Mein Manifest Anxiety, and Contentless Recall 
Recallers Nonrecallers 
(N = 13) (N = 15) 
iz a pbs 
Variable M SD M SD 1 l is 
Age, years 36.84 13.13 3433 7.94 72 ns E 
35 

Vocabulary 15.15 3.46 12.53 3.91 1.79 05 

Manifest anxiety 48 
Total 34.92 9.05 25.40 9.86 2.81 <.01 ‘50 
Overt 18.38 6.67 1146 5.66 2.86 01 = 
Covert 16.54 3.08 13.93 5.40 1.46 ns. ass 
Self sentiment 6.38 2.68 5.00 2.76 1.19 n.s. 59 
Ego strength» 5.00 1.88 2.06 2.08 3.77 <.01 = 
Guilt proneness 11.38 3.16 9.13 3.44 1.79 ns. ie 
Ergic tension 8.08 3.39 6.40 3.14 1.28 N.S. 

Manifest needs* pe. 
Achievement 14.54 3.73 13.86 2.98 51 ns. = 
Deference 15.62 3.91 13.64 3.04 1.43 n.s. = 
Exhibitionism 10.00 4.19 12.72 2.79 —i = E 
Autonomy 10.77 2.83 11.36 3.02 51 n.s. p” 
Intraception 19.23 4.14 18.86 3.30 -25 n.s. 35 
Succorance 14.53 4.07 11.07 5.18 1.87 .05 ae 
Endurance 14.62 5.69 14.57 5.10 02 n.s. 

75 

Contentless recall 8.85 3.19 1.87 2.75 5.79 .001 

N = =a _~9-,-_ ,, ray ad t 
^ One-tailed tests were applied to the predicted differences, two-tailed tests to the subcategories of manifest anxiety ® 
contentless recall, 
High scores indicate low self-se 


entiment and ego strength. 
$ For these variables, N Ni 


i = 14 for Nonrecallers, as one § did not complete the schedule. 
2 Hypothesis not confirmed; hence, difference not teste 


falling between rather than below the means 
of the Recallers and the Nonrecallers; any 
test, then, of the hypothesis that this group 
nxiety than the ex- 
ary. However, in or- 
r the relationship be- 
S significant over the 


d 
ni 
sible, such as methodological differences 5 
the fact that the present sample is — 
older than many of the other samples, 4 
as more homogeneous in occupation Pi 
heterogeneous in race. That the inte E 
and educational levels of the group TE a 
tively high—the mean vocabulary er 
the present sample was 13.84, ge at 
approximately the 90th percentiles o i 955) 
groups tested (Hagen & Thorndike, Mine, 
and to the 73rd percentile of the ACE Gra 
1957)—limits the generality of the fin is 
but does not significantly differentiate 


ger 


Discussion 


The findings of this study are, of course, 
limited because of the relatively small num. 


ber of Ss in each of the groups. Nevertheless, 
some of the findings are comparable to those 
of some earlier studies, and, where there are 
discrepancies, other factors may be respon- 


sample from previous samples in Tea 
studies. a? day t° 
There was a striking variation from A 
day in the number of people recalling ae 
the range was from 2 to 17 a day. A 5 hal 
of the Recallers’ daily variations revealed t a 
there was no significant trend for differe 


FY 


-drea 


Recallers and Nonrecallers of Dreams 


days of the week. Coefficients of correlation 
were also computed between the number of 
Nocturnal dream reports from the Recallers 
each day and the average temperature, hu- 
midity, and humiture for the corresponding 
Period (10:00 p.m. to 7:00 a.m.); ? the cor- 
relations were .16, .01, and .06, respectively. 
Previous studies have not accounted for either 
individual or group variability in recall over 
time. The present study has eliminated cer- 
tain factors, but leaves the observation un- 
explained, 
F The greatest deviation from earlier findings 
's that neither sex (McElroy, 1952; Middle- 
an 1942) nor age (Kleitman, 1939) was as- 
Sociated with ability to recall dreams. In view 
co is discrepancy, the present sample was 
1o Pared with those of Middleton (1933; 
tivit to determine whether recall produc- 
„3 itself differed to any great extent. In 
W ite of the fact that Middleton's findings 
hi based on responses to a questionnaire 
uring no documentation, the percentages 
a A Ss reporting experiences of a 
in Tequent or very frequent dreaming a 
alrly Close agreement with percentages 0 
Present sample reporting at least one 
Spe M, or being categorized as Re E 
aged Compared with reports by 2 
at = (1939), the present sample ope 
no Pical in the percentage stating that sf 
‘ver dream, The finding that Recallers a 
fener in verbal intelligence rae one 
ti dings (Ramsey, 1953), although the hat 
qo2ship was not a major one; the fact tha 
oe reports were written, thus ale 
weater demands both motivationally an = 
‘tionally upon the less verbally adept, sus 
‘Sts that, notwithstanding the earlier nah, 
e relationship may be partly artifactua = 
fa € results concerning the more, dyna si 
„ators of manifest needs and manifest p 
lety raise interesting theoretical — 
latticularly with respect to the unknown e 
lonship between manifest and page ened 
“stations of the same characteristic. 


ariables, for example, were initially thought 


in two categories. In the first, thought of 


n e United States 

ap ‘re obtained from the i 
Pas eee Were iture is a comfort-discomfort 
easure Shine py averaging temperature and hu- 


Midity for a given time period. 
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as situational, it was predicted that individu- 
als who had needs to do well (achievement), 
to “show off” (exhibitionism), and to please 
authority (deference and low autonomy) 
might be motivated to recall dreams because 
it was a classroom instructor who was asking 
them to do so; in a more pervasive motiva- 
tional category, it was predicted that people 
with stronger needs to understand themselves 
(intraception), to seek help (succorance), 
and to stick with problems (endurance) 
would be found among the frequent Recallers, 
in accordance with the theory that remember- 
ing dreams offers a unique opportunity for 
insight (Fromm, 1951), creativity (Murphy, 
1947), and problem solution (Hadfield, 1954). 
The negative findings leave open the question 
raised initially concerning the motivation for 
increased recall of dreams during psychoana- 
lytic therapy. It may be that the instrument 
used is not a valid one, or that needs with the 
names and characteristics studied here are re- 
lated to dream recall but not at the manifest 
level. , 

Similarly, the finding that manifest anxiety 
plays a substantial role in dream recall can 
mean either that anxious people are more 
urgently pressed to resolve the conflicts that 
dreams theoretically illustrate, that they have 
more such conflicts, or that persons who have 
erected fewer barriers between themselves and 
awareness of their anxiety are also more fully 
in touch with the rest of their internal ex- 
perience and, hence, recall dreams more fre- 
quently. The latter view receives some sup- 
port from the fact (Table 1) that the groups 
differed in overt but not covert anxiety, and 
that they did not differ in unresolved tensions 
(ergic tensions), but that the Nonrecallers 
were more able to “control and express” them 
realistically (Cattell, 1957, p. 5), 

The high correlation between remembering 


tless recall of dream- 
ew that low dream re- 
manifest anxiety, is re- 
Vhile it is obvious that, 
à eams, one must experi- 
i does not necessarily follow 
o do not recall dream 

also not remember dreaming, epedana 
the latter is an “easier” task, and the two 
categories were mutually exclusive. Tt seems 
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likely that the almost absolute lack of recall 
of dreaming itself is due to factors associated 
with repression or control, and that it is there- 
fore symptomatic of a more general lack of 
awareness of ongoing internal processes, 


Summary 


Forty-two graduate students in education 
turned in reports on recalled dreams every 
day for four weeks. They also completed the 
Edwards Personal Preference Schedule, the 
IPAT Anxiety Scale, and a short multiple- 
choice vocabulary test. On the basis of the 
frequency with which they recalled dreams, 
subjects were divided into a Sroup of Re- 
callers and a group of Nonrecallers, By means 
of ¢ tests applied to differences between the 
means of the subgroups on the variables 
tested, the following conclusions were reached: 


1. Men and women do not differ in fre- 
quency of dream recall. Small sample size may 
be a factor here, since the nonsignificant dif- 
ference was in the Predicted direction, 

2. Dream Recallers are not younger than 
Nonrecallers within the age range covered in 
this study. 

3. Dream Recallers are more 
than Nonrecallers, 

4. There is a positive relationship between 
manifest anxiety and fr 


equency of dream re- 
call. The findings also suggested that the dif- 
ference between Recallers and Nonrecallers 


intelligent 


variations in dream r call and variations in 
temperature, humidity, 


Schonbar 


ing is post 
7. Contentless recall of dreaming is P 
tively related to recall of dreams. 


tion 
The study was based upon the er, the 
that dreaming is a universal proce ae in 
basis of the present findings, bee... is- 
ability to recall dreams or dreaming operat | 
cussed in terms of a repressive tac oreca 
ing most successfully in total Non 


t 
* san etonig O 
Attention was called to the limitatio 
study. 
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INTERRELATIONSHIPS AMONG MMPI MEASURES 
OF DISSIMULATION UNDER STANDARD AND 
SOCIAL DESIRABILITY INSTRUCTIONS 


JERRY S. WIGGINS 


Stanford University 


sig tet studies of what Jackson and Mes- 
aspe (1958) have recently termed “stylistic 
a S of responses to personality inventories 
“soci i €voted considerable attention to the 
Man al desirability” component (Corah, re 
1952. Cohen, Gruen, Meadow, & Ringwall, 
8; Edwards: 1954, 1957; Fordyce, 1956; 
fone: 1956, 1957; Hillmer, 1958; Rosen, 
Socia] Voas, 1956; Wiggins & Rumrill, 1959). 
cial desirability response style may be de- 
iee general tendency to endorse or 
soe 9 inventory items that are judged to 
cially acceptable by people in general (Ed- 


Wards, 1957), Measurement of this response 
tandard 


yle has been indirect, at best. The s 
ce has 


ee of demonstrating its presen 
=i to correlate item endorsement beau 
abili Independently rated item social ao 
Si ity in groups of subjects taking @ p : 
Roy inventory (Edwards, 1957; Hanley, 

Such studies have demonstrated that 
an 76% of the variance involved in group 


endor ted for by item 
Sone sement may be eae This approach 


°cial desirability values a 

“ovides little information about the extent i> 
Which individuals are answering in Nae oe d 
em social desirability, and the eee 
relationship appears to be 0 omnipreser 
among self-report devices as to be 0 1958: 
Practical significance (Corah et al., ; 


ick, 1958)- 
ill i ccon & Messick, 195 
mer, 1958; Jackson ee ee errant 


i rt by a re- 

a This investigation We s Supp ational Institute of 
arci 2215, fro zi 

TEREA Aiie National Institutes of Health, 


Public Health Service- 


to identify individual dissemblers (Edwards, 


1957; Hanley, 1957; Wiggins & Rumrill, 
1959). Although not lacking in face validity 
or theoretical relevance, these scales lack evi- 
dence regarding their empirical (predictive) 
validity. Thus, the social desirability scale of 
Edwards (1957) (hereafter called En °) was 
constructed from rational sortings of 10 
judges. Evidence of its validity is its high 
correlations with the MMPI clinical scales 
and the K scale (Fordyce, 1956) and its low 
correlations with the Edwards (1954) EPPS 
scales which are presumably free of social de- 
sirability. The scale of Hanley (Ex) is more 
elaborately derived, although its validity again 
appears to rest on correlations with the MMPI 
scales, the K scale and the En scale (Hanley, 
1957). 

The validity of these scales becomes an im- 


ity exists that these scales (including K ) are 


cial de- 
s useful 
ney. In 
ve that 


y qualified (Jackson 


? Thi ; 
ferred pln Se usually called SD but is here re- 
to avoid aA indicate the 39-item version and 
study, ion with other scales in the present 
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& Messick, 1958; Wiggins & Rumrill, 1959). 
These possibilities may be investigated by re- 
course to the method of contrasting groups 
which estimates the actual efficiency of these 
scales in identifying social desirability dis- 
semblers. 

The method of contrasting groups has previ- 
ously been used to estimate the efficiency of 
existing MMPI measures of “defensiveness” 
and “plus-getting” (Cofer, Chance, & Judson, 
1949; Gough: 1950, 1954; Grayson & Olinger, 
1957; Hunt, 1948; McKinley, Hathaway, & 
Meehl, 1948; Meehl & Hathaway, 1946; 
Rosen, 1956; Schmidt, 1948) to estimate the 
fakability of certain scales (Benton, 1945) 
and to develop new measures of “dissimula- 
tion” (Gough, 1954) and “defensiveness” 
(Cofer et al., 1949). It would therefore seem 
to be the method of choice for evaluating cur- 
rent measures of “social desirability” response 
tendencies. The traditional procedure in these 
“role-playing” studies has been to contrast 
the protocols of small groups of subjects who 
have taken the MMPI under standard and 
one or more “fake” instructions. That this 
procedure introduces elements not present in 
the population to which results are general- 
ized is suggested by the studies of Grayson 
and Olinger (1957) and Voas (1956). Gray- 
son (1957) reports patients’ comments such 
as: “Well, I just put d 
what I did yesterday” 
presents clear evidenc 
time between self and ‘ 


An appropriate criteri 
desirability faking is diffi 
Edwards (1957) has pointed out, the extent 
of social desirability faking in a « 
group is unknown. This shortcomin 
peculiar to social desirability respo; 
however, and it seems reason 


on group for social 
cult to obtain for, as 


normal” 
g is not 
nse style, 
able to assume 
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f; jal 
that a relatively uniform group of high ar 
desirability responders may be erea Sui a 
special instructions to the subjects. * tend- 
group would differ in the amount of pa cri- 
ency and could, in principle, serve “ust 
terion group for distinguishing an style 
amount of social desirability response rpor 
from a small amount. Scales which we 
to measure social desirability en a 
should Presumably achieve a certain 4 from 
of success in differentiating such a grouP 
a “normal” group. ith the 

The present study is concerned ae 
empirical success of several MMPI aie “dis 
of “social desirability,” “defensiveness, distin 
simulation,” and “response bias La role- 
guishing groups of social desirabili Y onde 
players from comparable control terrela- 
Attention is also focused on the ail dis- 
tionships of these measures under bo 
simulation and standard conditions. 


Method 


a d t0 

The full scale MMPI was administer one 
440 undergraduate men and women uD jn the 
of two sets of instructions. The 190 a ofi 
control group received the standard = 
structions that is printed on the fron ler 
booklet. The 250 Ss in the experimenta s that 
received a modified set of inst ee ans 
was stapled over the standard iae o my 
the front of the booklet. The modi 
structions read, in part: 


le ii 
Read each statement and decide whether pt to 
General would consider a true or a false hether 
be more desirable. You are not asked w a ather 
Statement is true or false as applied to y0 ai think 
you are asked to decide which anew T 
People in General would consider to be 
sirable. 


an 
These instructions were supplemented y ade 
explanation that the judgment to culture 
was of the general values of American® aa 
rather than of any particular gbin A be 
that the hypothetical respondent wa: e. 
considered as of the same sex as me vdan 
The protocols were scored for the S ee eee 
MMPI clinical scales, including Welsh welt 
tor scales. In addition, 11 special scales T 
scored which are presumably measure: AA 
dissimulation, social desirability, or EN 
bias. These scales are briefly described be 


MMPI Measures of Dissimulation and Social Desirability 


L, F, K: These are the well-known validity scales 
a ae MMPI (Mechl & Hathaway, 1946). L is a 
'Sitem rational measure of Ss’ tendencies to give 
an unrealistically favorable picture of themselves. F 
a a 64-item rational measure of malingering which 
qssts of items scored in a direction that is rarely 
chosen by normals. K is a 30-item empirical measure 
ite “defensiveness” or “minus-getting.” Twenty-two 
aig Were selected which differentiated patients with 
‘eh L scores and normal profiles from a comparable 
iP of patients with abnormal profiles. To me 
c mS were added cight items which remained u 
i under role-playing instructions in Le 
CREN and which also differentiated severe 

ed patients from normals. ; ee 
ability Refers to the 39-item rational social a 
ney Seale developed by Edwards (1957) = 
ee (1956) and usually designated es 
> Were instructed to answer 149 items oe 
Wi p » K, and Taylor Ansiety scales) in su k 
aY as to give the most socially desirable picture = 
age Selves (Edwards, 1958). There was unanimo s 

neient on 79 items which were subsequently i 
N to 39 items by item analysis. Items are ey 

» © desirable direction, MEET 
ability Refers to the 26-item rational socia spa 

iy Scale developed by Hanley (1957). A poo of 
Hathan (which were endorsed by 36 to 
to y 


A eee 

away’s college students) was given to a | 

Statin 2D 2 9-point scale of social desira sa ed 
“Stical criterion of high- and Jow-rated items wa 


> And the 26 items that survived were keyed in 


desirable Rin, 
direction. : eae 
Social 4 Sd-R: Refer to the 39- and 40-item rational 
tor Seu 
Comh; 
ang an pool of 79 items was rated for 
alse” responses on a 7-point sca ğ 

Sap 88s. SLA is a pool of low-rated | items; and 
scale is a pool of neutral or moderate items- 

Co, are keyed in the desirable direcion: en nn 
i e i rica 
Refers to the 34-item Lees His, 
h were unchanged 


ged under 


Evelo 1 
CEIS by Cofer and associates 


Unde: of those reliable items whic a 
fake, {#ke-bad instructions but were Cavers i total 
of Booed instructions in a design utilizing a 
tes S. Two judges agreed that this item po erik 
thee statements of low social deraba in 
desi; are frequently endorsed. Items are hes T 
rep Table direction. Cross-validations have 

“Ported 

«dissimula- 


5: Refers to the 74-item empirical a hee 


tion»: . A 
aan Scale developed by Gough (1954) im hi le con- 
sigs SCOnceptions about neuroticism. This se iit. 
tou, of those items which differentiate eE ike neu- 
toties, and normals from Ss instructed to ta fasted 
Withe™: A group of 111 dissemblers was COTA tion 
“th 176 patients. Items are keyed in the direc a 
da p trotie dissimulation. Extensive cross-validation? 
a are reported. eos 
Scale Refers to the 63-item rational ic eee 
of © developed by Fricke (1957). This scale © i 
those non-K items endorsed by 40 to 60% o 
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Hathaway's combined college and normal groups. 
These items are arbitrarily keyed “true and pro- 
yide-a measure of acquiescent or response-bias tend- 


ies. is , TRE N 
sd: Refers to a 40-item empirical social desirability 


scale developed in the course of the present study 
This scale consists of those items which discriminate 
Ss instructed to answer in a socially desirable direc- 
tion from a comparable control group. A group pr 
178 dissemblers was contrasted with 140 controls. 
Items are keyed in a socially desirable direction. 
Cross-validational data is available.* 


Results and Discussion 


Clinical Scales 


Comparisons of mean raw scores on the 
clinical scales between the dissimulation and 
control groups were made separately for men 
and women by means of £ tests. In contrasting 
the mean scale scores of the 144 experimental 
men with the 105 control men, significant re- 
ductions at the .001 level were found on Si, 
Hy, and R (in order of decreasing magni- 
tude). At the .01 level, a decrease occurred 
on Pt and an increase on Ma. Welsh’s Scales 
A and D were found to have decreased sig- 
nificantly at the .05 level. To the college male, 
social desirability seems to involve social ex- 
traversion, high activity, and an absence of 
anxiety and somatic complaints. (The last in- 
ference comes from the fact that Hy-subtle 
scores tended to be almost identical under the 
two conditions, while reliable differences oc- 
curred on Hy.) 

Larger and more numerous differences were 
found in contrasting the 106 experimental 
women with the 85 control women. Signifi- 
cant reductions in mean score were found on 
Si, Mf, Pt, A, R, Hy, and Hs—all at less than 
001. At the .01 level, decreases occurred on 
D, Sc, and Pd. College women seem to ascribe 
more stringent and widespread criteria of so- 
cial desirability to our culture (as our culture 
does to college women). Again we find social 
extraversion and an absence of anxiety and 
somatic complaints as socially desirable—this 
time without the associated high activity level. 
More pronounced among women than among 
men are the decreases in deviant thinking and 
deviant social attitudes found in Si 


c and Pd. 

The latter two were also tendencies in men 
) 

3 Description of scale 


devel bn à . 
a later publication. opment is reserved for 
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Table 1 : 
Raw Scores on Dissimulation Measures Under Standard and Social Desirability Instructions 
Mean Raw Sco; lah É 
: Sd 
fi F K Enr Ex Sd-A SdR Cof Ds B 
Group “4 se F 
5 32.5 5 3 7 5 10.83 28.01 24.0 
i a 21 16.85 32.51 16.52 30.34 29.73 20.25 1 3 753 
eee a6 oo o 152 587 5.68 5.13 7.28 4.69 7.29 8.07 6.28 
Men UV = hi F, 
5 3 5 7.8 3 10.52 26.46 120 
Mea 2.80 5.24 16.33 30.99 13.25 27.81 26.91 12.95 3.59 
aaa = 105) S 1.76 3.60 455 495 332 718 3.75 359 619 6.12 
Nlen pr E. 
17.89 
l 851 23 .76 220 570 272 5.08 947 33 194 ol 
p .001 .05 .001 Oi 001 001 
235 97.13 
7 7 3 79 2143 9.40 28.25 5 
i tal Mean 7.41 4.29 17.74 33.33 17.90 31.49 30.79 z 6.6 
e =106) SD 3.82 3.80 5.54 5.56 417 676 330 621 740 6.6 
ä i m 1 12.41 
Control Mean 3.07 3.67 15.59 2940 12.91 25.65 2741 11.19 EA ee 3.07 
Women (V=85) SD 2.09 2.52 4.23 4.92 2.98 7.03 2.12 3.72 5. Ss A 
17.9 
t 9.41 1.29 297 519 9.28 5.82 7.59 13.38 1.10 1.02 ‘001 
Pp 001 OL -001 001 001 001 O01 = 


although not statistically reliable ones. A 
striking difference between experimental and 
control women which did not occur between 
men was found on the M f scale. By implica- 
tion, college women tend to see themselves as 
more masculine than our culture would have 
them, 

These clinical scale differences are highly 


similar to those reported by Rosen (1956) in 
a situation in which the sam 


e Ss responded 
in terms of self-ratin: 


Earlier reports of n 


J milat 
virtually identical for men and highly be - 
for women, which further confirms otecting 
servation that F is of no value in de 1949; 
positive malingering (Cofer et al., Hatha- 
Gough, 1950; Hunt, 1948; Meehl “itference 
way, 1946). Although a reliable di i 

in mean K raw score occurred ete denti- 
groups of women, K scores were almost dditiv® 
cal in the two groups of men. The @ 


Cofet 
combination of Z and K suggested by e de- 


would contribute nothing further to the ant 
ormal Ss faking good on tection of male dissemblers in the Pior G 
the MMPI (Cofer et al., 1949; Hunt, Carp, study. Cofer reports differences 1 
Winder, & Kantor, 1948; 


Validity Scales 


Table 1 presents 
the dissimulation 


3 es for 
mixed group, and Rosen found citer eal 
the sexes treated separately. Honi in ( 8) 
lier study reported in McKinley et a’ of the 
found no differences in K for either ugges!® 
Sexes treated separately. McKinley S ecaulse 
that no differences were found on K ituatio? 
of some factor in the experimental sl 
that resulted in exceptionally high K 
standard conditions. Apparently, ma 
was not operative in the present desig! ST 
the raw K scores under control conditio: 


sinc? 
for 


o not 
measures under Standard Stanford men and women (Table ) by 
and role-playing instructions for men and significantly depart from the norms § (x 2 
women treated separately. The reliable differ- McKinley for college men and women The 
ences in L scale scores for both men and 16.10, o = 5.15; X = 15.58, « = 4.20). ip 
women are in accord with those reported by actual screening efficiency of L and 
Cofer et al. (1949) and by R 


osen (1956). 


Mean F scores under the two conditions were 


x aoe d in 
identifying college dissemblers is discuss 
the next section. 


MMPI Measures of Dissimulation and Social Desirability 


Special Scales 


The remaining columns of Table 1 show 
the special scale differences under standard 
and role-playing instructions for both sexes. 
For the men, Sd, Cof, Ex, and Sd-R show 
a reliable difference at the .001 level. Sd-A 
Was different at the .01 level and En at the 
05 level. The response bias scale (B) ap- 
Proached, but did not attain, significance in 
this group. For the women, Sd, Cof, Ex, 
Sd-R, Sd-A, and En were all reliably different 
at the .001 level. 

The actual screening efficiency of these 
Measures was assessed by combining the sam- 
Ples into a group of 250 dissimulators and a 
Stoup of 190 controls and calculating the pro- 
Portion of hits and misses at various cutting 
Scores for each scale, Space limitations pro- 
ib it the presentation of the complete dis- 
tribution for each of the scales. However, 

able 2 shows the degree of successful classi- 

Cation involved at the cutting score which 
Hyumizes both false positives and false nega- 

es, 

A certain amount of overlap between the 
Stributions of dissemblers and controls is 


€ expected on the grounds that an as yet 


; To known proportion of dissemblers will be 
Und in any control group. However, it 1s 


di 
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ent. The success of Sd in identifying dis- 
semblers is, no doubt, somewhat spurious in 
that the scale was developed on part (72%) 
of the present sample. To test the extent of 
spurious inflation, Sd was scored in independ- 
ent samples of 50 control college men and 72 
college men instructed to answer in terms of 
social desirability. At a cutting score of 21 or 
above, the scale successfully identified 68% 
of the dissemblers and 100% of the controls 
(phi = .683). The success of Sd in the pres- 
ent study is therefore more than suggestive. 

The empirical scale of Cofer (Cof), which 
was developed 10 years ago on a quite dif- 
ferent college sample, is able to correctly 
identify 65% of the dissemblers and almost 
all of the authentic records at a cutting score 
of 20 or above. Cofer et al. (1949) reported 
correct identification of 86% of his dis- 
semblers and 96% of his authentic records 
(phi = .641). This was accomplished by re- 
scoring the same records from which the scale 
was developed. The shrinkage in percentage 
of correct identification in the present study 
would be expected on cross-validation. De- 
creasing the cutting score in the present sam- 
ple would, of course, increase the proportion 
of correct identification of dissemblers at the 
expense of increased false positives—which 
could be well afforded. Gough’s (1950) ear- 


[el wn . 

int from Table 2 that es oe lier observation that Cofer’s scale “gives 

a ucted) dissemblers may ‘with better promise of being a very interesting addition 

than oa Ste eg ovantage of em- to the pool of MMPI keys” (p. 409) is well 
ance success. 


Pitical scales in this enterprise is also appa- 


borne out by the present results. 


Table 2 


Screening Efficiency of 


Dissimulation Measures 


Simulated Records 


Authentic Records 


(N = 250) (N = 190) 
Prop: Propi Prop. Prop. 
Cutting ae ee Called Called Phi 
Scale Score Authen. may Authen. Simul. Coeff. 
2 7: 

Sd 21 or above oe ae 98 02 A21 
Cof 20 or above 38 62 96 04 619 
L 6 or above 4 33 91 .09 530 
E: 18 or above : 5 91 09 ‘461 
Sa. 31 or above AS 92 ‘86 A ‘ 

ae above 37 63 72 ae 395 
Sd-A ey 54 - 28 386 
En 36 or above a 46 'g5 15 oe 
K 22 or above .29 “30 i pe 
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In accord with expectations, the L scale is 
indicative of dissimulation. The extent to which 
identification of simulated protocols could be 
improved is limited by the low cutoff in this 
15-item scale. The rational social desirability 
scales of Hanley (Ex) and Wiggins and Rum- 
rill (Sd-R, Sd-A) appear to identify dissimu- 
lated records at slightly better than chance 
level while minimizing the proportions of false 
positives rather successfully. Lower cutting 
scores might be of some practical value in 
these scales. 

The rational scale of Edwards (Ev) which 
is probably the most widely used of current 
measures of “social desirability” misclassifies 
more dissemblers than it correctly identifies, 
Considering that the dissemblers in the pres- 
ent study were instructed to respond in terms 
of “social desirability” as defined by Edwards 

(1957), the En scale is clearly not what it has 
been assumed to be. 

The present findings, with respect to K, 
add more negative evidence concerning the 
meaning of K in populations other than the 
original (Hunt et al., 1948; Schmidt, 1948; 
Tyler & Michaelis, 1953: Welsh & Dahl- 
strom, 1956). It is clear that high K, in a 
college sample, is not prima facie evidence of 
social desirability faking. It should be noted, 
however, that low K is a fairly good indica- 
tion of the absence of this response tendency. 
Neither of these statements contradicts cur- 
rent clinical practices in regard to the inter- 
Pretation of K (Welsh & Dahlstrom, 1956). 


Response Bias 


The need for differentia 
“stylistic” 


it seems appro- 


t to which other 
response styles may be operative in account- 


ing for the same variance, One such response 
style is that of “acquiescence” which has been 
studied in other contexts (Jackson & Messick 
1958). Fricke’s “response bias” scale (B) 
may be considered a measure of acquiescence 
since it consists of 63 items of high “am- 
biguity” that have been arbitrarily scored 
“true.” The failure of B to discriminate dis- 
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Table 3 


Correlations of Dissimulation Measures with the 
Response Bias Scale Under Standard and 
Social Desirability Instructions® 


Men Women 
Social Social 
Desira- Desira- 
Standard bility Standard bility 


(N=105) (N=144) (N=106) (N =85) 


Sd 373 —248 103 
Cof 084 426 172 
L -45 —461 —320 
Ex —432 —501 —449 
Sd-R 126 —305 —066 
Sd-A =575 —672 — 633 
En — 594 —607 — 588 
K — 648 —692 —615 
a For N = 100; an r of .257 is significant at the ,01 level. 


semblers from nondissemblers (Table 2) sug- 
gests that it represents a stylistic component 
mainly irrelevant to the task of identifying 
social desirability dissemblers. There are, m: 
doubtedly, factors other than “response bias 

which contribute to the variance of the B 
scale, but it would seem to serve as the best 
available operational definition of response 
bias tendencies. For this reason, the eight 
measures of dissimulation were correlated 
with the “response bias” scale under both 
standard and role-playing conditions. Table 3 
presents these correlations. 

Dissimulation scales such as Sd, Sd-R, and 
Cofer’s scale (Cof) are relatively free from 
this bias, while K and the scales of Edwards 
(En) and Hanley (Ex) are more subject to 
its effects. The response bias properties of & 
have been noted by several authors (see Jack- 
son & Messick, 1958), and the possibility of 
response bias in En and Ex was noted in ‘But 
earlier paper by the present author (Wiggins 
& Runrill, 1959), e 

In addition to the individual differences in 
susceptibility to response bias among the dis- 
simulation measures, it is interesting to note 
the different degrees of this set that appear to 
Operate under the two conditions of adminis- 
tration. In general, it appears that dissimula- 
tion instructions act to increase the operation 
of the response bias factor. This is in line 
with Hanley’s suggestion that acquiescent in- 
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dividuals might have a tendency to be defen- 
Sive as well (Hanley, 1957). 


Intercorrelations A mong Dissimulation Meas- 
ures 


Table 4 shows the intercorrelations among 
dissimulation measures for the 105 men under 
Standard instructions (lower left) and the 144 
men under experimental instructions (upper 
tight). Dissimulation scales which are slightly 
or insignificantly related under standard con- 
ditions become highly interrelated under in- 
Structions to answer in terms of social desir- 
ability. Tt might be hypothesized that a dis- 
Simulation set increases both response bias 
(denial) and social desirability tendencies. 
Since all of the scales appear to measure both 
Of these tendencies in varying proportions, 
the effect of dissimulation instructions might 

e to increase the intercorrelations among 
Measures, 
Tt thus becomes difficult to choose between 
the Scales under dissimulation instructions. 
Ome choice is possible under standard in- 
Structions, however. Here the fallacy of de- 
veloping a rational measure based on the cor- 
relation with a presumed measure of social 
desirability, such as K, becomes apparent. In 
Beneral, the higher the correlation with K, the 
ose empirically effective is the measure of so- 
“lal desirability, This could be due to the fact 
lat K contributes response bias and other 
variance irrelevant to the identification of so- 
mal desirability dissemblers (Hanley, 1957). 
„Ae clear exception to this trend is found 
n Sd-R, which is not an effective empirical 


Table + 
Intercorrelations Among Dissimulation Measures for 
105 Control Men (lower left) and w 
Experimental Men (upper right) 


= ae —" 
Sd Cof L Ex Sd-R Sd-A En K 
G 880 801 783 720 596 590 665 
-d 450 797 775 756 155 mt ta 
Ex =034 353 798 582 601 m ka 
Sa. 115 488 359 646 702 714 848 
Sat 348 351 090 321 629 633 606 
En 045 416 253 601 253 978 She 
K 062 428 282 725 286 803 
—014 385 350 696 110 659 1 f 
aS a ——— 
ae = 125; an r of .231 is significant at the 01 level. 


measure of social desirability but which is so 
free of response bias (Table 3) as to be virtu- 
ally unrelated to K under standard instruc- 
tions. 

The scale which is most similar to Sd, un- 
der standard instructions, is the scale of Cofer 
(Cof). This similarity is not surprising con- 
sidering the manner in which the scales were 
developed. Cofer’s scale is based on items 
which were changed under fake-good instruc- 
tions, with the additional property that they 
were also left unchanged under fake-bad in- 
structions. The development of Sd was, in 
part, a cross-validation of Cofer’s procedure 
and, as might be expected, 14 of Cofer’s 
items appear in the Sd scale. The two scales 
appear to be equally free of response bias 
(Table 3) and almost equivalent in their 
ability to screen social desirability dissemblers 
(Table 2). It appears that Sd and Cof are 
the best available experimental scales for in- 
vestigating social desirability response tend- 
encies in the MMPI. 

Correlations between Hanley’s scale (Ex) 
and En, K, L, and Cof are similar to those 
reported by Hanley (1957). It should be 
noted that, on the basis of these correlations, 
Hanley felt that Cof was of little value com- 
pared with K, En, and Ex (p. 394). Ed- 
wards’ scale (En) is seen to be highly simi- 
lar to Sd-A, as was suggested in an earlier 
paper (Wiggins & Rumrill, 1959). It is also 
substantially related to K, against which it 
was partially “validated.” 


Social Desirability in the MMPI 


Studies by Fordyce (1956), Hanley (1957), 
and Edwards (1957) have done much toward 
creating the impression that the MMPI clini- 
cal scales are heavily saturated with social 
desirability response style. Such “social de- 
sirability” is a matter of definition, however, 
and these studies have rested on the correla- 
tions of En and Ex with the clinical scales as 
evidence of the susceptibility of the clinical 
scales to this bias. The correlations in Table 5 
are especially relevant to this line of reason- 
ing. The columns represent the dissimulation 
measures in decreasing order of their effec- 
tiveness in identifying known (instructed) so- 
cial desirability dissemblers. The rows repre- 
sent the MMPI scales, and the data are those 
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Table 5 


lations of Dissimulation Measures and MMPI Clinical Scales for 
ag 105 Control Men Under Standard Instructions® 


Dissimulation Measures 


cae Sd Cof £ Ex Sd-R  Sd-A En K 
Hs —019  —190 001 —388 —266 —496  —563 —347 
D —327  —388 085 —412 -386 -393 434 —150 
Hy —090 —068 203 140 —169 = 034 = ~024 348 
Pd —061 —399 102 454 242 486 528 349 
Mf —309 —510 —046 —312 _499 —366 —318 —177 
Pa 010  —134 052 016 —122 287] —171 034 
Pi Z103 —537 —3733 —6988 -37⁄3 807 —844  —751 
Sc 09 = 503-262-616 «= 359) — 753—803 638 
Ma 170 —125 199 = _399 028 394 476 581 
Si =334  —303 =123 —552) 463 =575 —632 —556 
A —049 —523 —326 666 -%42 —894 —g00 —781 
R —299 043 366: 271. —516 275 331 573 


«For N = 100; an r of .257 is significant at the .01 level. 


of the 105 control men who represent a stand- 
ard MMPI group comparable to those em- 
ployed by others, 

Table 5 shows a trend for the more accu- 
rate empirical measures of social desirability 
(Sd, Cof, L) to be only slightly correlated 
with the clinical scales, and for the less ac- 
curate measures (Sd-A, En, K) to be more 
highly correlated with the clinical scales. A 
convincing case can be made for the influ- 
ence of “social desirability” in the MMPI by 
using the Edwards scale (En) as a measure 
of this response style. However, if one were 
to employ an actual empirical measure of this 
tendency, such as Sd, the case is considerably 
weakened. Several of the correlations of Sd 
and Cof with the Clinical scales suggest that 
social desirability is indeed a factor to be 
reckoned with in normal populations—even 
though its influence has been exaggerated in 
previous studies. 

It is also apparent, from Tables 4 and 5, 
that scales such as En, Sd-A, and K share a 

ment that runs throughout the 
MMPI clinical scales. Table 3 strongly sug- 
gests that this element is, in part, some form 
of “response bias.” There are now a con- 
siderable number of studies (see Jackson & 
Messick, 1958) which Suggest that this “te. 
sponse bias” is related to the primary factors 
measured by the MMPI and that it may 
well reflect valid (criterion-relevant) variance 


rather than “error” in assessment. In any 
event, it seems clear from the present study 
that the various “stylistic” components of a 
ventory responses must be carefully separate’ 
and that recourse to empirical procedures 15 
a requisite to eventual clarification of their 


role in personality inventories, such as the 
MMPI, 


Summary 


The empirical validity of several ezis DE 
measures of social desirability in the MMP. F 
was investigated by the method of contraste 
groups. A group of 250 college men EA 
women were instructed to answer the MM 
in terms of the social desirability of the items. 
A different group of 190 college men GH 
women received standard MMPI instruc one 

Although two empirical measures of socia 
desirability were relatively effective in identi 
fying dissemblers, certain rational social a 
sirability scales, and especially that of Ed- 
wards (SD), were found to be poor predicto 
of the criterion. The rational social desirabi $ 
ity scales which were ineffective in predicting 
dissimulation were found to be substantially 
correlated with an independent measure of re- 
sponse bias. It was suggested that previous 
reports of the influence of social desirability 
on the MMPI clinical scales would be more 
appropriately considered as studies of re- 
sponse bias. It was emphasized that these 


x 
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two “stylistic” components should be differ- 
entiated and that empirical methods are the 
Methods of choice in such an enterprise. 


Received August 28, 1958. 
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Many studies have shown low, but signifi- 
cant, correlations between Rorschach human 
movement (M) responses and general intelli- 
gence (Levine, Spivack, & Wight, 1959). The 
M response has been conceptualized as both 
a product and a measure of the delay func- 
tion of the ego, or of inhibition ability (Singer, 
1955; Singer, Wilensky, & McCraven, 1956). 
Since intelligence test performance may be 
conceptualized in terms of ego function 
(Fromm, Hartman, & Marschak, 1954; Rapa- 
port, Gill, & Schafer, 1945), the question 
arises whether it is possible to relate more 
specific measures of delay, not only to gen- 
eral intelligence but, also, to details of intelli- 
gence test performance itself. 

Our conception is similar to the position 
detailed by Rapaport (1951) in which the 
“apparatuses” of cognition develop in child- 
hood as a function of inevitable delay in 
gratification, and that the further develop- 
ment of thinking (memory, fantasy, abstrac- 
tion, problem solving, and planfulness) sup- 
ports increased delay or inhibition of the 
expression of impulses in consideration for re- 
ality demands. With increased age, thinking 
becomes increasingly a substitute for direct, 
impulsive action and can serve as a partial 
discharge of tensions, 

Since the many aspects of thi 
a sense equivalent to what we test when we 
test intelligence, it should be possible to dem- 
onstrate a relationship between general intel- 
ligence and measures of ability to delay which 
bear no obvious similarity to the kinds of 
tasks employed in intelligence tests. More- 
over, if this conception is valid, it should be 
possible to isolate instances in intelligence 
test performance wherein the ability to inhibit 


or delay plays an integral part in success or 
failure. 


inking are in 


Method 
Experimental Tasks 


Time estimation. This task required ma 
the subject (S) tell E when a 15”, 30”, bs 
60” time interval had elapsed. Two estimates 
at each time were obtained in random order. 
The scores used were the sums of both esti- 
mates for each of the three time intervals 
Higher scores are considered indication © 
better delay functioning. 

This task was selected since a prior study 
With a similar population had shown the time 
sense to be related to the ability to delay 
impulse gratification by responding to dis- 
tant incentives (Levine & Spivack, in press)- 
Singer and Opler (1956) and Singer, hid 
sky, and McCraven (1956), working wit 
adult schizophrenics, have shown that accu- 
racy of performance on this time estimation 
task is related to other measures of inhibition 
ability. d 

Stroop color-word test. This test, as gaapte 
for the present study, required S: (a) to ae 
aloud as quickly as possible four color an 
(red, green, blue, and yellow) which ad 
printed on a white card in black ink a tota 
of 50 times (B/W card); (b) to name as 
quickly as possible the color of the ink in 
which 50 color names were printed where the 
color name and the ink hue are incongruent 
(C/W card). Faster reading times are in- 
dicative of greater ability to control or 1m- 
hibit a strong interfering habit in performing 
this task. 

Previous investigators (Klein & Salomon, 
1952; Lazarus, Baker, Broverman, & Mayer; 
1957) have accepted performance on this task 
as a measure of an ability to regulate com- 
peting responses or to resist the effects of in- 
terfering response tendencies. This task was 
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employed in the present study due to its con- 
ceptual similarity to a previously employed 
Measure of “cognitive inhibition” (Meltzoff & 
Levine, 1954; Levine & Meltzoff, 1956). 
B Rorschach M tendency. The series of 26 
en M-threshold inkblots (Barron, 1955) 
A employed, with instructions for one re- 
pre per card. The score used was the total 
umber of M responses produced. 
a M tendency was employed because it 
call een shown to be related both theoreti- 
ti y and experimentally to ego delay func- 
oning, and has been the central operational 
Measure in much of the research in this area 
(Singer, 1955; Singer, Wilensky, & McCraven, 
1956), 
* General intelligence. General intelligence 
ty measured by the Wechsler-Bellevue 1n- 
telligence scales. These measures were ob- 
taineq from the clinical records of the insti- 
tution and on the average the IQ tests were 
administered 15 months prior to the other 
eXperimental procedures. 


Subjects 


23 emotion- 


The population consisted of 1 
ential treat- 


ally disturbed adolescents in resid 
Ment. There were 86 males and 37 females in 

© group. All diagnoses were represented, ex- 
CPt for the psychoses and chronic brain syn- 
drome, The average age was 16 years, with a 
Tange of 12 to 19. The mean IQ was 101, 
with a range of 70 to 140. The distribution 
of IQs was essentially normal, and the stand- 
ard deviation was 14.6. 


Procedure 


Each S was seen individually and was pre- 
sented with the battery of tests as “an at- 
tempt to develop some new tests.” The Ss 
were assured that the present test results were 
purely of an experimental nature and would 
not be entered into their clinical records. The 
Ss were generally cooperative, and the tasks 
seemed readily understandable. 


Results 


The intercorrelations of the experimental 
measures are presented in Table 1. The sig- 
nificant correlations between all three meas- 
ures and IQ support the hypothesis that meas- 
ures of ego delay are related to general intel- 
ligence. 

In order to obtain a clearer picture of the 
meaningfulness of these correlations in terms 
of 1Q points, the distributions of each of the 
three delay measures were split at the median, 
and mean IQs for the upper and lower half of 
each were compared. Only the distribution of 
the 60” time estimations was employed, pri- 
marily because it correlated best with the 
other variables. The # tests for IQ differences 
in the three measures considered individually 
are all significant, as would be expected from 
the significant correlations. Based on any 
single measure, the good and poor “inhibitors” 
differ on the average from five to eight IQ 
points. When we selected those Ss who were 
good and poor on all three delay measures, 
we found a mean difference between groups 
of 17.2 IQ points. The difference is signifi- 
cant, by t` test, well below the usually ac- 
cepted probability levels. 


Table 1 
Intercorrelations* Among 1Q and the Measures of Ego Delay 
2 3 ” 
Variable 1 ae 3 5 6 
ac aaa aa ees — 

1. Time Estimation 15” ii T a =712, 01 
2. Time Estimation 30” E —.04 22 
3. Time Estimation 60” i 07 132 
4. Stroop C/W? reading —.27 =.53 
5. Barron M total 25 
6. Wechsler IQ 


a ee 
t at the .05 level (two-tail test). 
a which reading time for the black 


* For an N of 123, correlations of .19 are significan 
conse All correlations involving C/W are partial 7s, in 
Ntrol for general reading speed. * 


and white card was partialled out to 
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Since the tasks were taken as different 
measures of the delay function of the ego, 
the interrelationship among them becomes 
important. It can be noted in Table 1 that 
the intercorrelations are significant, with the 
exception of those between time estimations 
and M. 

In order to relate the three ego delay meas- 
ures to intelligence test performance itself, 
we examined the relationship between our 
three measures and scores on the digit span 
subtest of the Wechsler. This particular sub- 
test was chosen on the basis of Wechsler’s dis- 
cussion of it as a test of concentration and 
ability to attend (Wechsler, 1944, p. 84), and 
our own evaluation of this task as requiring 
in part the ability to control or inhibit com- 
peting or extraneous thoughts and stimuli. 
Digit span total raw scores were related to 
each of the three measures of ego delay, 
controlling for level of general intelligence 
through the use of the roving median chi- 
square test (Cronbach, 1949). The relation- 
ship between digit span and the C/W task 
approached significance (x? = 3.5; p= .06) 
as did the relationship with time estimation 
(x'= 3.0; p=.08). The relationship be- 
tween digit span and M was not significant. 


Discussion 


These findings provide further support for 
the hypothesis that measures of an ego delay 
function are related to general intelligence. 
While the correlations between IQ and the 
specific measures tend to be low, when we 
select individuals who are good and poor 
inhibitors consistently, the mean IQ difference 
(17.2 points) is rather substantial. It would 
appear that as we develop more reliable and 
more precisely defined measures of delay 
functioning, it should be possible to increase 
the correlation substantially. The low corre- 
lations among the different measures, 


fact that time estimation and M do 
relate, 


and the 


not cor- 
Suggest that there may very well be 


more than one important style of control 
(Singer, Wilensky, & McCraven, 1956). The 
fact that M does not correlate with time esti- 
mation is consistent with other recent find- 
ings which suggest that the M response in 
childhood and adolescence does not have the 
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same interpretive value as in adults (Levine, 
Spivack, & Wight, 1959; Litwin, 1957). 
One reservation should be kept in mind in 
that the present population was an emotion- 
ally disturbed one. Impulsivity is Barac 
istic of many of the adolescents we used, an! 
the possibility exists that in a normal Ga” 
the relationship under investigation migh 
differ either in degree or kind. It is also pos- 
sible that the same study in a normal group 
would require more sensitive measures, s 
impulsivity might manifest itself more subtly 
and less pervasively in normals. hat 
The finding with digit span indicates that 
in adolescents not only are delay mechanismi 
related to general level of intelligence, but 
that the specific operation of such mechanz 
may be identified in the details of intelligence! 
test performance itself. This finding, alone 
with those of prior studies with adults (Le 
vine, Glass, & Meltzoff, 1957; Levine, SP! 
vack, & Wight, 1959) indicate that it D 
eventually be feasible to discuss intelligam 
“behavior” within the general framework A 
ego psychology. The task remains to exP pE 
further various relationships between E 
ures of control and qualitative aspects of a 
telligence test performance. An area worth - 
ploring is that of the nonintellective sae et 
intelligence test performance. An indivi a 
with poor delaying ability may not pea 
vere when the diffculty of the task aron 
anxiety or it becomes apparent that a qu! si 
solution is not forthcoming. He might one 
acteristically respond with the first hoes 
that comes to mind, whereas holding pe, 
self in check and reflecting a moment me 
permit him to develop a response be ; 
would score two points instead of one. ah 
possibility also exists that in individuals W} T 
good delay functioning, a positive value s 
placed on thinking and “intellect”—thinkins 
functioning for such individuals as both a ie 
rect and indirect gratification. For such eS 
viduals, manipulating abstract concepts, ¢ F 
veloping vocabulary, and the idea of findin E 
the answer may be gratifying. Such qualitie E 
are certainly assets in taking an intelligen¢ 
test. A more detailed analysis of the attitudes 
and approach of the subject throughout the 
test might reveal more clearly the relation- 
ships between personality and intelligence- 


ee 


Intelligence and the Ego’s Delay Function 431 


ee such relationships have been clearly 
CRE it may be possible to develop a more 
aa $ theory in which intelligence and per- 

ality variables may be discussed in the 
same terms. 


Summary 


ee purpose of the present study was to 
ates nstrate a relationship between three 
ee of ego delay function, general intel- 
a level, and performance on the digit 
The subtest of the Wechsler-Bellevue (1944). 
dela results support the hypothesis that ego 
a y function, as measured by M, time esti- 

ation, and the Stroop test, is correlated with 
Bho Performance on the digit span subtest was 
the St to be related to time estimation and to 
eral troop (1935) test independently of gen- 
fea Intellectual level. The results suggest the 
uy of treating intelligence test per- 

mance and personality variables within a 


Si a 
ngle theoretical framework. 
axes 

eceived August 28, 1958. 
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Since symptoms which resemble mental de- 
ficiency often result from the schizophrenic 
process, it is sometimes difficult to distinguish 
patients who are schizophrenic but not men- 
tally defective from those who are both. The 
resultant errors may be deleterious to the non- 
defective schizophrenic, in that they inhibit 
appropriate therapy. 

The present Paper reports a study of the 
characteristics of a number of cases in which, 
after a psychiatric interview, a diagnosis of 
mental deficiency was erroneously made in 
addition to the finding of schizophrenia. 


ords at a neuropsy- 
that 41 out of ap- 
s bore a diagnosis 
and psychosis. 

to test each of the 
ellevue Intelligence 
nine were testable, 
of 70 or above, de- 
ere clear indications 
of psychotic disrup- 
This group of 17 pa- 
ther study. 


man, & Goldman, 1943; Hunt & Cofer, 1944) 
indicate that an estimat 

unreasonable. It would appear, therefore, that 
1This study was supported b 


y the Social Science 
Research Committee of the Uni 


versity of Chicago, 


despite their diagnosis, the 17 patients = 
aS a group, in the average range of intellectua 
endowment. The mean age of these panen 
was 56.9 years. Eight of them were over | i 
years of age, the maximum age for wa 
Wechsler provides IQ tables. For these eig 2 
patients, the weighted score-IQ equivalent 
for ages 55-59 were used. This procedure 1S 
Conservative, for purposes of this study, since 
it slightly underestimates the IQs. e 

The patients had been diagnosed on m 
basis of a psychiatric interview soon after r 
mission. The 17 diagnoses had been made by 
nine different psychiatrists. , 5 

The main purpose of this investigation was 
to determine how these 17 schizophrenic a 
tients, who were misdiagnosed as mental = 
fective as well as psychotic, differed eit 
other patients who were diagnosed only as 
Psychotic. n 

In order to make the comparison, a 26-pa 
tient control group, chosen from the same 
wards, was selected so that they had the a 
mean year of birth (1896) and mean year 0 
admission (1940) as the experimental group- 
For each of these measures the variances were 
almost identical for the two groups. 

The experimental and control groups were 
compared with respect to educational and Oc: 
Cupational level, two social history variables 
which were thought to be of possible impor- 
tance. The control group was found to have 4 
slightly higher mean educational level (8.2 
years) than the experimental group (6.7 
years), but the difference was not statisti- 
cally significant (p = 36). 

The highest occupational level attained by 
each S was scored, using the median Army 
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General Classification Test score for World 
War II inductees as reported by Stewart 
(1947). The purpose of this comparison was 
to determine whether a patient was likely to 
diagnosed as mentally defective because 
is occupation was one usually held by peo- 
ple of low intelligence. The mean A.G.C.T. 
Score corresponding to the occupations was 
‘6 for the experimental group and 105.9 
Or the controls. The difference was significant 
at the .01 level, 
_ The two groups were next compared on 
‘agnosis aside from the finding of mental de- 
ciency, Although both groups consisted en- 
tirely of patients described as functional psy: 
Chotics, they were found to differ markedly 
a the number of patients who were labele 
in terms of the classic subtypes of schizo: 
renia, Of the experimental group, less t ‘d 
One-third were diagnosed either ye 
ebephrenic, catatonic, or simple, while ke 
€ control patients received such a diagn ane 
Ver two-thirds of the experimental paten $ 
received a diagnosis of “psychosis with m 


psy one 
tal deficiency,” or some similar lapel of 
of the cases was there mentioned a This ob- 


Psychosis other than schizophrenia. ther the 
Servation raised the question of Le Side 
eXperimental patients may have pores sal 
Prroneous diagnosis in part perane symp- 
’cked those distinctive schizophrenic SY ‘ie 
oms which make it possible to diagnos 
Patient in terms of classic subtypes. — 

t therefore seemed desirable to sympto- 
the two groups of patients on The psychia- 
Natology at the time of intake. «the intake 
trist’s description of the patient = patient’s 
Nterview was copied from Sout to be 
Older. These descriptions were two groups, 
°F about equal length for i the experi- 
Showing a mean of 33 lines Pe the control 
Mental group and 32 ciate three psy- 
Stoup. Using these descr the Multi- 
Chologists rated each patie 


P jatric Pa- 
ting Psychiatric 
„mensional Scale for A oe those 42 items 
S 


usi. 5 aaa 
cc, (om, Be h for use by an interview. 
ing psychiatrist. { ratings were compared 


The three sets ‘lity by means of an intra- 


‘ iabi 
ce, interet ao onestetent (Haggard, 1958). 
S corr 


t the ratings were reliable 
t was found tha 
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nce < .05) on all except two 

feos A A 26). These two items 
were eliminated from further computations. 

The Multidimensional scale allows the rater 
to mark an item as undecided. W heneyer two 
of the three raters marked an item unde- 
cided” for a given patient the item was 
dropped for that patient, but if ooy one 
judge marked it undecided, the ratings of t k 
other two judges were used, and a — - 
ing was obtained for each item on eac bi 

The items of the Multidimensional scale are 
grouped by the test authors into 12 symptom 
clusters or “factors,” 8 of which are com- 
posed primarily of items from the psychiatric 
rating portion of the scale. The two groups 
of patients were compared on their ma pa- 
thology rating on each of these eight c vea 
The two clusters labeled by the test ai o 
as conceptual disorganization and poreeptua 
distortion were found to discriminate the two 
groups of patients, and both were in the pre- 
dicted direction. That is, the experimental 
group was rated as significantly less patho- 
logical than the control group, the differ- 
ence being significant at the .05 level, com- 
puted by a two-tailed Mann-Whitney test. The 
symptom clusters on which the two groups 
did not differ significantly were those labeled 
paranoid projection, melancholy agitation, 
motor disturbances, hysteric conversion, self- 
depreciation vs. grandiose expansiveness, and 
retarded depression vs. manic excitement. 

The two symptom clusters which distin- 
guished the groups might be thought to be 
those which interviewers would consider most 
clearly indicative of psychosis. To verify this 
impression, the eight cluster labels, together 
with the designations of their several respec- 
tive item dimensions, were submitted to 13 
psychiatrists to rank order on the extent to 
which the symptom clusters are important for 
distinguishing psychosis from nonpsychosis. 

The two predicted symptom clusters were 
rated as the most important. The mean rank- 
ings for perceptual distortion and conceptual 
disorganization were 1.8 and 2.5, respectively, 
while the mean rankings of the other six fac- 
tors were, in the order listed above, 4.4, 6.1, 
3.6, 7.5, 5.7, and 4.5. 

It appears, then, that those patients bear- 
ing the additional diagnosis of mental de- 
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ficiency showed fewer symptoms that are 
usually thought of as identifiably psychotic. 
Although the interviewing psychiatrists saw 
sufficient signs of psychosis to diagnose the 
patients as such, they evidently responded to 
the paucity of distinctively psychotic symp- 
toms by adding the diagnosis of mental de- 
ficiency. 


Summary 


Seventeen schizophrenic patients who, on 
the basis of an interview, were misdiagnosed 
as mentally defective in addition to their diag- 
nosis as psychotic were compared with 26 
controls who were diagnosed only as schizo- 
phrenic. The experimental group was found 
to have attained a lower occupational level 
than the controls, and was reported to have 
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exhibited less distinctively psychotic symp- 
toms in diagnostic interviews. 


Received September 2, 1958. 
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Teachers College, Columbia University 


m major focus of research in psycho- 
Etec has been on the evaluation of its 
stud s. Comparatively little has been done to 
ma; Set qualities of psychotherapists which 
aa ee to the success of psychother- 
hat « Tost theoreticians and therapists agree 
enter the psychology of the psychologist . - - 
peutic into the determination of the thera- 
p ic product” (Rogers, 1949; Shoben, 1949, 
` 367). Research has shown that people 


r . 
ated as better therapists are seen by their 


ie Ts, colleagues, and supervisors to be hap- 
i T less anxious, better adjusted, and more 
Toe ble persons than are those rated as poorer 
E Pits (Bandura, 1956; Kelley & Fiske, 
1; Luborsky, 1952). 
Almost all schools of psychotherapy accept 
a € thesis that good psychotherapy involves 
Sood interpersonal relationship in which the 
Bene or client can feel accepted, and in 
Ich the therapist must be an accepting 
Person, Research findings have tended to sup- 
Port the hypothesis that better, more expert 
rapists are more accepting than are poorer 
€rapists, This conclusion has been deduced 
ie inditect evidence (Fiedler, 1950a; Fied- 
£, 1950b; Strupp, 1957), or from colleagues’, 
ola or supervisors’ evaluations of training 
1 erapists (Kelley & Fiske, 1951; Luborsky, 
252). No investigations, however, have di- 
a dissertation submitted 


f doctor of philosophy 
University. Apprecia- 


1 ry 
in his paper is based upon 
Tandag for the degree ©: 
ion Cachers College, Columbia Aomain 
com: is expressed to the members of the disserta n 
Ro. mittee, Joel R. Davitz, Laurance F. Shaffer, = 
ise A. Schonbar. The original report (Streitfe! , 
of = may be consulted for more detailed treatmen 
€ rationale, methods, and results. $ 
tio Presented at the American Psychological Associa- 
n meeting at Washington, August 28, 1958. 


rectly tested the widely held proposition that 
better therapists are more accepting persons. 

Since theory has suggested (Fromm-Reich- 
man, 1949; Rogers, 1951) and research has 
demonstrated (Berger, 1952; Sheerer, 1949; 
Stock, 1949) that a person’s ability to accept 
others is positively related to his feelings of 
self-acceptance, these attitudes might well be 
investigated together. 

The purpose of the present study was to 
make a direct test of the hypothesis that bet- 
ter psychotherapists are more accepting of 
others and more self-accepting than are poorer 
psychotherapists. The measures of the psy- 
chotherapists’ attitudes are in terms of ex- 
pressed acceptance of others and expressed 
self-acceptance. 


Hypotheses 


It was hypothesized that therapists who 
are more accepting of the self and others are 
better therapists, as rated by their super- 
visors. They also rate their psychotherapeutic 
ability more accurately, that is, in better 
agreement with their supervisors’ ratings. It 
was also hypothesized that, since the more 
accepting therapists rate themselves more ac- 
curately, the relationship between the self- 
ratings and the degree of acceptance is greater 
for the more accepting therapists than for the 
less accepting therapists. 

_Corollary hypotheses were that the super- 
visors and the subjects, respectively, are in- 
ternally consistent. For both the supervisors 
and the subjects, ratings of case movement 
and of psychotherapeutic ability are posi- 
tively related. A final corollary hypothesis 
was that expressed acceptance of self is posi- 


tively related 
others, to expressed acceptance of 
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Subjects 


Two groups of Ss were used in the experi- 
ment. The Ss were third- and fourth-year 
doctoral candidates in clinical, counseling, 
and school psychology, most of whom had 
completed a year’s internship. 

Group 1 consisted of 28 graduate students 
who were enrolled in a practicum in psycho- 
logical counseling at Teachers College, Co- 
lumbia University, during the academic year 
1956-1957. Group 2 consisted of 51 graduate 
students or graduates who had been in the 
practicum during the academic years 1953- 
1954, 1954-1955, 1955-1956, and who re- 
sponded to the request for data. Of 76 for- 
mer students from whom the data was re- 
quested, 51 or 67% responded. 

The practicum runs for an entire academic 
year. Students see clients in a clinic, integral 
with the department, under intensive super- 
vision of professional members of the staff, in 
supervisory groups of three or four. 


Procedure 


The procedure involved th 
expressed acce 
self-acceptanc 
Berger (1952 
therapeutic a 
vised specific: 


e use of scales of 
ptance of others and expressed 
which were constructed by 
) and rating scales of psycho- 
bility and of case movement de- 
ally for the present experiment. 


Measures Obtained 


Six measures wer 
the supervisors. 

The two measures obt 
pervisors were their rati: 
therapeutic ability of the 
current supervisory grou 
of the therapeutic moy 


e obtained from the Ss and 


ained from the su- 
ngs of the psycho- 
Ss in their past and 


Three measures were o 


btained from all of 
the Ss; namely, 


ratings of their own psycho- 
therapeutic ability and expressed acceptance 
of others (AO) and expressed self-acceptance 
(SA), as measured by Berger’s (1952) scales. 
In addition, the Group 1 Ss rated the thera- 
peutic movement of each of their clients, 
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Ratings of the movement of the counseling 
cases were obtained for Group 1 Ss only, since 
their clients had been most recently seen and 
were, therefore, more likely to be rated accu- 
rately by both the Ss and the supervisors. 


Rating Scale of Psychotherapeutic Ability 


The rating scale of over-all psychothera- 
peutic ability was as follows: 


6—One of the best 07% 
5—Considerably above average 18% 
4—Somewhat above average 25% 
3—Somewhat below average 25% 
2—Considerably below average 18% 
1—One of the poorest 07% 


The supervisors were asked to rate the a 
in the six categories, using as a referen i 
group all students they had known at a sa 
lar level of training. Further, they were aa 
to select three individual students whom t 7 
considered “best,” “average,” and Don ei 
in psychotherapeutic ability, and to e 
of these three students as specific referen 
points in making the ratings. in the 

The Ss were asked to rate themselves in ce 
above categories, using as a reference gro 


jmilar 
all the students they had known at a simi 
level of training. 


Rating Scale for the Movement of Cases 


x ach 
The rating scale for the movement of ¢ 
Case contained two steps, as shown: 
Step Step 
I II 
3—Above average 


o 
6—Great progress o7% 
5—Considerable 18% 
progress 
2—Average 25% 
4—Above average 35% 
3—Below average a 
1—Below average 13% 
2—Very little progress 
1—No or almost no o7% 


progress 


The supervisors and Ss were individually 
asked to rate the movements of the cases ah 
in the categories under Step I, and then T 
the scores under Step II. They were asked 1 
use as a reference group the movement of es 
clients or patients in counseling or psycho 


therapy with similarly trained students they 
have known, 
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Berger’s Scales 


ae on the development, reliability, and 
cepta y of Berger’s scale for expressed ac- 
nce of others and expressed self-accept- 
Mea vere published by him (1952). Since 
ance cales reflect expressed feelings of accept- 
and aps and realistic acceptance of self 
er; others may not necessarily be revealed. 
ee expressed the belief that “Immature 
0; unrealistic persons may score very high 
n SA & AO.” ; 
P using the Berger scales in the present 
ste it was assumed that most graduate 
ing nts and graduates of a clinical, counsel- 
would. school psychology training program 
Secur be sufficiently mature, realistic, and 
ance « So that a basic and realistic accept- 
To of the self and others may be inferred 
m the scores they achieve on the SA and 
Scales, äi 
Ten Berger’s scales were validated under 
Was tions of anonymity of Ss, a procedure 
Scale devised, in the administration of the 
simil for the present study, to maintain 
o; Pa conditions, The responses and ratings 
Fi Ss were kept unidentifiable to the su- 
So ‘lems and the experimenter. The Ss were 
Ormed in advance. 
of è determine the variability and re 
in the Berger scales with the populati 1 
€ present study, a pilot study was con: 
“cted in which the scales were administered 
with e Group 1 Ss and the results compared 
Com, those obtained by Berger (1952). 
Parison of the pilot study group with 
S erger’s seven groups indicated an adequate 
Pread of scores on both Berger scales. Split- 
alf reliabilities of .79 and .99 were found 
°r the AO and SA scales, respectively, indi- 
ating adequate reliability for use in the pres- 


ent study. 


d reliability 
ion used 


Results and Conclusions 


All the hypotheses were evaluated with 
arson product-moment correlations, and 
ested for significance with the ¢ test, except 

ere otherwise indicated. In each case the 

Probability was estimated on the basis of a 
Wo-tailed test. The mean, standard devia- 


3 
27 E. M. Berger. Personal communication. February 
, 1957, 
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Table 1 


Means, Standard Deviations, and Ranges of 
Scales Used in the Present Study 


Scale N Mean SD Range 
Expressed acceptance of 
others 79 115.76 9.66 95-132 
Expressed self-acceptance 79 145.35 16.87 93-174 
Ratings of psychothera- 
peutic ability by super- 
visors 79 437 128 1-6 
Ratings of psychothera- 
79 4.57 86 2-6 


peutic ability by Ss 


Ratings of psychothera- 
peutic movement of cli- 


ents by supervisors 91 382 131 1-6 


Ratings of psychothera- 
peutic movement of cli- 
ents by Ss 91 


3.64 1.65 1-6 


tion, and range for each scale are presented 
in Table 1. 


Main Hypotheses 


The hypothesis that therapists who are 
more accepting of the self and others are bet- 
ter therapists, as rated by their supervisors, 
was tested by correlating supervisors’ ratings 
of Ss’ psychotherapeutic ability with Ss’ 
scores on Berger’s SA and AO scales. Non- 
significant correlations of —.02 and .09, re- 
spectively, were obtained, which failed to 
support the hypothesis. Correlations of su- 
pervisors’ ratings of Ss’ psychotherapeutic 
ability with Ss’ scores on Berger’s scales were 
also obtained for the Group 1 and Group 2 
Ss separately. None of the correlations was 
significant. 

The hypothesis that the more accepting 
therapists rate their psychotherapeutic ability 
more accurately, that is, in better agreement 
with their supervisors’ ratings, was tested by 
correlating Ss’ scores on the SA and AO ae 
with the differences between the Ss’ self-rat- 
ings and the supervisors’ ratings of them, A 
significant negative correlation would confirm 
the hypothesis. Two measures of the differ- 
ences between the supervisors’ ratings of Ss 
and Ss’ self-ratings were obtained. One meas- 
ure was the differences without signs, the ab- 
solute differences; the other measure was the 
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algebraic differences. To avoid the use of 
negative numbers, a constant, 10, was added 
to each algebraic difference. 

None of the correlations between the scores 
on the acceptance scales and the differences, 
both absolute and algebraic, between super- 
visors’ and self-ratings were significantly dif- 
ferent from zero. Nonsignificant correlations 
also resulted for Ss who scored in the upper 
and lower 50% on the AO scale and on the 
SA scale. As the Ss’ scores on Berger’s scales 
are independent of the differences between 
Ss’ self-ratings and supervisors’ ratings of Ss’ 
psychotherapeutic ability, the hypothesis was 
not supported. 

The hypothesis that the relationship be- 
tween the self-ratings and the degree of ac- 
ceptance is greater for the more accepting 
therapists than for the less accepting thera- 
pists was tested by correlating the Ss’ scores 
on Berger’s scales with Ss’ ratings of their 
own psychotherapeutic ability for Ss scoring 
above and Ss scoring below the fiftieth per- 
centile on each of the Berger scales, The sig- 
nificance of the differences between the cor- 
relations of the upper and the lower 50% 
on each of the Berger scales was tested by 


the transformation of the correlations into z 
scores, 


Table 2 


Correlations of Subjects’ Scores on Berger's Scales 
with Self-Ratings by Subjects 


Differences 
Correla- Between 
tions Correla- 
with tions of 
i Self- High and 
Berger’s Scales N Ratings Low 50% 
Expressed acceptance 
of others 
High 50% 39 21 
Low 50% 39 =27 A8* 
All Ss 79 -06 
Expressed self- 
acceptance 
High 50% 39 01 
Low 50% 39 —.03 04 
All Ss 79 -28* 


* Significant at1.05/level, 


Streit feld 


Table 3 


Correlations of Ratings of Case Movements by Super- 
visors and Subjects, with Ratings of ‘Subjects 
(N = 28) by Supervisors and Subjects 


Ratings of Ss 


_ Oe 
Ratings of Case By Super- 
Movements visors By Ss 
By supervisors 
9 
Highest rating per S .60** re 
Lowest rating per S as Tio 
Mean rating per S Mi id $ 
By subjects © 
Highest rating per S .06 03 
Lowest rating per S 36 41" 
Mean rating per § .42* p 


** Significant at .01 level, 
* Significant at .05 level, 


J 
As shown in Table 2, the correlation oi Ss 
self-ratings with Ss’ scores on Berger's ff- 
scale is positive for Ss scoring above the Ae 
tieth percentile on the AO scale, and en 
tive for the Ss scoring below the fiftieth re 
centile. Though the difference betwen ca 
two correlations is significant at the .05 le tly 
neither correlation, by itself, is signin 
different from zero. No significant meee 58° 
was found between the correlations a SA 
self-ratings and their scores on Berger $ ela 
scale for Ss scoring above the fiftieth P 
centile and Ss scoring at and below, oe 
tieth percentile on the SA scale. While ESS 
is a small but significant relationship © cale 
self-ratings and their scores on the SA Sı for 
for all Ss, there is no such relationship tile, 
Ss scoring at and below the fiftieth percen tile 
or for Ss scoring above the fiftieth perce? ily 
on the SA scale. The hypothesis was partia 
supported. 


Corollary Hypotheses 


e 
The corollary hypotheses, that for both 2 
supervisors and the Ss, the ratings of ate 
movement are positively related to rae 
therapeutic ability, were tested by correla ne 
the highest, lowest, and mean ratings of 
therapeutic movement of the clients seen md 
the Group 1 Ss with the respective sup 4 
visors’ and Ss’ ratings of the Ss’ psychother 
peutic ability. As indicated in Table 3, Wi 
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levels, 


Which is significant at the .01 level. 


Additional Findings 


Cas 


„ here is a positive correlation of .56, 


. > d 
ificant at the .01 level, of supervisors’ an 


S ratings of case movement. 


Table 4 


Correlations of Supervisors’ Ratings of Subjects 


<a with Sclf-Ratings by Subjects ? 


the sole exception of the lowest ratings of 
Case movement by the Ss correlated with the 
Ss’ self-ratings, the hypotheses were supported 
by Correlations significant at the .01 and 05 


The final corollary hypothesis, stating that 
= €Xpressed acceptance of self is positively re- 
í lated to expressed acceptance of others, was 
= tested and supported by a correlation of .53 
© between Ss’ scores on the two Berger scales, 


_ As shown in Table 3, except for the posi- 
tive Correlation, significant at the .05 level, of 

€ mean rating of case movement by Ss and 
“tpervisors? ratings of Ss’ psychotherapeutic 
ability, ratings of case movements by super- 
Visors are independent of Ss’ self-ratings of 
Psychotherapeutic ability, and Ss’ ratings of 
© movements are independent of supervi- 


Sets) ratings of Ss’ psychotherapeutic ability. 
sig- 


ti Table 4 shows that there is a positive rela- 
lonship, significant at the .01 level, between 
SUpervisors’ ratings of Ss’ psychotherapeutic 
follity and Ss’ self-ratings. The positive rela- 
‘Onship exists for Ss scoring below the fif- 


Corre- Differences 


lations Between 
with Correla- 
Self- tions of 
Subjects Rated by Ratings pea 
Supervisors N bya TE 
Hi 
igh 50% of expressed 
acceptance of others 39 -19 .35 
“OW 50% of expressed ee 
acceptance of others 39 54 
High 50% of expressed 
self-acceptance 39 -26 
| Low 50% of expressed 2 
Self-acceptance 39 Sore 
a, Als 79 Ao 


i 
| ** Significant at -01 level. 


tieth percentile on the AO scale and for Ss 
scoring below the fiftieth percentile on the SA 
scale, but not for the Ss scoring above the 
fiftieth percentile on either of the scales. The 
difference between the correlations of low and 
high Ss on both scales, as tested by the trans- 
formation of the correlations into 2 scores, 
was not significantly different from zero. 

Further analysis of the data revealed that 
of the 39 Ss who scored at and below the fif- 
tieth percentile on the AO scale, 28 Ss also 
scored at and below the fiftieth percentile on 
the SA scale. The correlations of the super- 
visors’ ratings of Ss’ psychotherapeutic abil- 
ity with Ss’ self-ratings were .50 for the 28 
Ss who scored at and below the fiftieth per- 
centile on both scales, .13 for the 11 Ss who 
scored low on only the AO scale, and .74 for 
the 11 Ss who scored low on only the SA scale. 
The correlation for the Ss who scored low on 
only the AO scale is not significantly different 
from zero. The other correlations are signifi- 
cant at the .01 level. 

Discussion 

The confirmation of the corollary hypothe- 
ses indicated at least an internal consistency 
by the supervisors and by the students, and 
some measure of concurrent validity of the 
instruments used in the study. 

The therapists’ self-ratings of their psycho- 
therapeutic ability are most closely related to 
their highest ratings of the psychotherapeutic 
movement of their clients. They are also re- 
lated to a lesser extent to their mean ratings 
of case movement, and are not at all related 
to their lowest ratings of client psychothera- 
peutic movement. The findings strongly sug- 
gest that the therapists tended to perceive 
their own psychotherapeutic ability more in 
terms of their psychotherapeutic successes 
than in terms of their comparative failures. 


Expressed Acceptance of Self and Others, and 
Psychotherapeutic Ability 


The results of the present study failed to 
support the hypothesis that better psycho- 
therapists are more accepting of others or 
more self-accepting than are poorer psycho- 
therapists. They indicate that, among selected 
graduate students in clinical, counseling, and 
school psychology training programs, there is 
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no relationship between expressed acceptance 
of self or others and judged psychotherapeutic 
one positive finding was that the cor- 
relation of therapists’ self-ratings of their 
therapeutic ability with their expressed ac- 
ceptance of others was positive for the thera- 
pists expressing more acceptance of _ others, 
and negative for the therapists having less 
expressed acceptance of others, the difference 
being significant at the .05 level. The finding 
may be due to chance since neither of the 
correlations was, in itself, significantly dif- 
ferent from zero. 

An additional finding suggesting further ex- 
amination is that therapists having compara- 
tively low expressed acceptance of self and 
others and those having only comparatively 
low expressed self-acceptance perceived their 
psychotherapeutic ability more as their su- 
pervisors evaluated them than did the thera- 
pists with greater expressed acceptance of self 
and others and even those with only lower 
expressed acceptance of others. The findings 
suggest that the greater degree of similarity 
may be related to low self-acceptance rather 
than to high self-acceptance as postulated. 
Perhaps the less self-accepting therapists are 
less secure and do not form as independent 
judgments as do the more self-accepting 
therapists. They might seek evaluation from 
their supervisors more frequently and be more 
sensitive to their supervisors’ opinions than 
the more self-accepting therapists. 

Another possible explanation for the find- 
ings that the low scorers on AO and SA rate 
their therapeutic ability more as their super- 
visors rate them than do the high scorers is 
that Berger’s idea that “Immature and un- 
realistic persons may score very high on SA 
and AO” is correct and applicable to the Ss 
in the present study contrary to the assump- 
tion made in the study. If so, the high scorers 
on the “acceptance” scales would be less re- 
alistic and therefore less “ 


accurate” in their 
self-ratings. Similarly, Berger’s idea may ac- 
count for the positive correlation of self- 


ings and AO scores for the high AO sco 
and the negative correlation for the low 
scorers. Unrealistically high self-ratings by the 
high scorers might account for the Positive 
correlation. To the extent that the high 


rat- 
rers, 


AO 
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istic, the 
scorers on Berger’s scales are unrealistic, 


conclusions based on the present study would 
be limited. 


Implications 


The findings suggest that, contrary to e 
common opinions among psychotherapists @ i 
theoreticians, better therapists are not a 
sarily more accepting people. If it is true ie 
acceptance of the patient or client 1s ne 
sary to good therapy, it may be that pe T 
psychotherapists are capable of being ac¢ E 
ing of their patients or clients during the Pa 
chotherapeutic hours. They would not T Ta 
sarily have to be accepting of all peop Ei a 
people in general, all of the time. Fiedler that 
Senior (1952) suggest the possibility a/or 
therapists are able “to ‘soft pedal’ ue 
disguise those aspects of their persona nts) 
which would be distressing to the Pa elt 
and emphasize, instead, those aspects of spit- 
personalities which are reassuring and E Eet 
ing” (p. 452). Rogers (1957) wrote ine f 
is not necessary . . . that the therapist gra- 
paragon who exhibits this degree of im jife- 
tion, of wholeness, in every aspect of i aa 
It is sufficient that he is accurately hims 97): 
this hour of this relationship . - oan (P stiga- 
Thus it may be necessary, in the invé set 
tion of the contribution of the one 
personality to good psychotherapy, 1o Ede 
the therapist's personality as it is man da 
in the therapeutic situation. Notwithsta no 
this possible modification, this study m 
support the hypothesis that general a ho 
ance of self or others is related to PSY’ 
therapeutic ability. 


Summary 


js 

A direct test was made of the ypo z 
that better psychotherapists are more ak d 
ing of others, and more gliaccepHni is 
are poorer psychotherapists. This bere 5 0 
held by most psychotherapists and schoo 
psychotherapy. 

The 79 subjects were current and jinicals 
students in the doctoral programs in Teach 
counseling, and school psychology at were 
ers College, Columbia University, who three 
taking, or had taken in the previous 


j 5 + psy” 
years, an intensive required practicum in P 
chological counseling. 


forme 


——— 
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ye criterion of psychotherapeutic ability 
Eth e ratings of the subjects’ supervisors 
s, practicum. Each supervisor supervised 
enti an four students per semester. Thera- 
also movement of each subject’s clients was 
Meas rated. The acceptance variables were 
Self Accs has Berger’s scales of Expressed 
Others. ptance and Expressed Acceptance of 
age results failed to support the hypothe- 
Chote, relationship was found between PS) 
sors erapeutic ability, as rated by supervi- 
expre and expressed acceptance of self or 
RS acceptance of others. Ratings of 
to oe ability were found to be related 
and a of therapeutic movement of clients, 
e Xpressed acceptance of self was found to 

related to expressed acceptance of others. 
m igh there are limitations of the study 
results « of the scales and subjects used, the 
hecess Suggest that better therapists are not 
ance sarily more accepting persons. If accept- 
Peuti is a necessary ingredient 1n the thera- 
Dist: ic process, it may be that better thera- 
tio S are more accepting in the specific situa- 

ns of therapy. 


Rece; 
Ctved September 8, 1958. 
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DISCRIMINATION OF FEMALE SCHIZOPHRENICS 
WITH CONFIGURAL ANALYSIS OF THE 
MMPI PROFILE 


WILLIAM J. EICHMAN 1 
Veterans Administration Hospital, Roanoke, Virginia 


Although the MMPI was originally de- 
signed to discriminate between various diag- 
nostic categories, early research reported dis- 
couraging results in this respect, These early 
studies were largely confined to ¢ tests be- 
tween groups on individual scales, Recently, 
more complex approaches have been used, 
among which is a configurational analysis of 
paired scores within a Particular profile. Sul- 
livan and Welsh (1952), who developed the 
methodology, demonstrated some success with 
this method in discriminating ulcer patients 
from controls, Taulbee and Sisson (1957), 
using the same methodology, were able to 
discriminate schizophrenics from heurotics in 
a sample of male VA patients. In both stud- 


ies, cross-validation showed good reliability 
for the signs. 


y with schizophren- 
mportant in regard to 
the results. Neverthe- 
gns upon a sample of 
elded discouraging re- 
resent study. It is not 


» Particularly when pa- 
Sex are used as subjects. 
S whether these results 


In addition to the ab 


son study has limited utility. Thei 
group was composed 
making it necessary to 


nk Hayden L, Mees, 


Washington, Ralph 
Simon, VA Hospital, Perry Point. M: 


John Altrocchi, Duke University 


` » for providing pro- 
tocols for cross-validation, 


means, all character and personality disor yal: 
organics, manic-depressives, etc. This pie E 
an awesome problem, particularly in reen ma 
the character and personality disorders, a fr 
these groups show symptomatology whic Be 
Pears to be between that of the neurotic a 
schizophrenic groups, both qualitatively ia 
quantitatively. The present study meee 
these nosological categories in the a, 2 
group. Thus the problem is to develop aish 
of signs from the MMPI that will disting (a 
between two groups of female patient 
an unselected heterogeneous group of A 
diagnosed as neurosis, character or be neous 
disorder and (b) an unselected, heteroneiiat 
group of women who had a primary pane a 
of schizophrenia. Considerable sage 2 
Sullivan-Welsh methodology ‘can be in the 
Those refinements which were included if dat- 
present study are: (a) the use of the val 
ing scales in the development of Signs) hes 
the use of numerical difference scores a two 
than the simple “+” or “—” used in ridation 
Previous investigations; (c) cross-va s dition 
of signs in other hospital settings in a ope 
to the one in which the signs were deve signs 
and; (d) application of weights to the 3 
which will maximize the discrimination 
tween groups. a vesti- 
A secondary problem which was E a 
gated concerned the use of the K sca A 0 
suppressor variable. Since the introducha a 
this scale, it has been almost routine ¢ Ai, 
practice to add a prescribed proportion 0 jca 
K score into the scores of five of the ci j 
scales before converting raw scores into Ta en 
ard scores. Although discrimination Deg a 
diagnostic groups might be improved by Ps Fay 
a practice, important statistical disadvantaé 
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are introduced, i.e., experimental independ- 
ence is reduced. The authors (McKinley, 
Hathaway, & Meehl, 1948) of the K scale 
mtroduced these weights with the caution 
that other weights might be more practical in 
Other situations, This problem has never been 
ully investigated. The approach used in this 
study was to develop signs from both the K 
Weighted and the unweighted profiles, utiliz- 


mg that set of signs which offered more po- 
tential, 


; Method 
Subjects 


cl The Ss used for the validation of signs in- 
ded all female veterans in the Veterans 
i ministration Hospital, Roanoke, Virginia, 
‘iho had been administered the MMPI and 
ee had received diagnoses fitting the cri- 
th ia described below. Approximately half 

ese Ss had been administered the test on 
r mission as part of a battery, and the test 
“sults had some influence on the diagnosis. 
te © remaining half of the Ss were adminis- 

red the test for different purposes, €-8-, Pre- 
Psychotherapy evaluation, evaluation of cur- 
Et Status, etc., and the test had no influence 
mi agnosis, e.g., the test may have been ad- 
g Stered a year after diagnosis had been = 
penned, This latter group, however, include 
"any chronic patients whose symptomatic 
Picture had changed and who would not have 
P eived the same diagnosis were they to be 
“evaluated. 


Control Group 


digstitty-three patients were me 
.8osed neurosis, personality ot charac 

‘orders, The percentage of patients in each 
sm was: (a) neurosis 62%, (b) character 
aga Personality disorders 38%. The mare 
8e of the group was 37.0, with a standar: 


ds. 
leviation of 10.1 years. 


found who were 


Schizophrenic Group 


Fifty-six patients were found who had a 
‘agnosis of schizophrenia. These broke down 
“cording to the following categories: (a) 

tonic, undifferentiated, 52%; (b) paranoid, 
toi (c) catatonic, 4%; (d) schizo-affec- 
Wve, 4%; (e) hebephrenic, 4%; and (f) 
Simple, 2%. 
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The average age of the group was 33.6, with 
a standard deviation of 6.6 years. Many of 
these patients showed little or no overt psy- 
chotic symptomatology. Initially, this study 
had been planned to use two schizophrenic 
groups, one with overt psychotic symptoma- 
tology and one with subtle psychotic symp- 
tomatology. The judgment of “subtle” or 
“overt” was made on the basis of whether 
one or more of the following existed at the 
time of the test administration: (a) delusions, 
(b) hallucinations, (c) gross confusion of 
thought processes, (d) gross loss of control 
over behavior, (e) profound withdrawal, (f) 
other bizarre behavior. Of the 56 patients 
who comprised the total schizophrenic group, 
28 were assigned to each group. Thus half 
the validation group showed no immediate 
signs of schizophrenic psychosis at the time 
of administration of the MMPI. Results are 
reported for each of these groups separately. 


Sign Analysis 

Seventy-eight scores were obtained for each 
patient. Twelve of these were the T scores on 
the 12 scales used in the study. The remain- 
ing 66 were the difference between T scores 
for pairs of scales, using all combinations of 
the 12 scales, €g, L—K, L—F, LHS, 
...L—-Ma,K-—F,K—Hs,...K—Ma 
.. . Sc— Ma. This procedure was followed 
for both the K weighted and the unweighted 
profiles. All scores which reached the .05 level 
of significance with the use of the F ratio 
were retained as signs for the scale. 

After the significant signs were determined, 
a cutting score for schizophrenia was arbi- 
trarily set at the bottom of the class interval 
in which the mean score for schizophrenics 
fell. (To simplify the computations, scores 
were grouped in intervals of five T score 
points.) Thus a plus score would be assigned 
to somewhat more than 50% of the schizo- 
phrenic group on each of the significant signs 
and to a lesser proportion of the control 


group. 
Results 
Analysis of the K weighted profiles resulted 
in 23 difference scores and 4 single scale 


scores which significantly differentiated the 
schizophrenic from the control group. Identi- 
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Table 1 
MMPI Scale Scores for Schizophrenic and Control Subjects (K Corrected) 
Ma 
Group L K F Hs D Hy Pd Mf Pa Pt Se 
= 59.4 
Schiz 57.4 564 604 542 623 606 648 50.0 63.9 55.9 50 30.0 
Control 53.8 53.5 57.6 609 698 665 702 45.8 63.0 597 5 + = 


cal analysis of the unweighted profile resulted 
in a slightly greater number of significant 
signs but yielded less satisfactory discrimina- 
tion between groups, both in the validation 
and cross-validation samples. Consequently, 
further data and discussion is limited to the 
MMPI profile with the K weights applied. 
These mean scores are presented in Table 1. 

The significant signs with the appropriate 
cutting score for the scoring in the schizo- 
phrenic direction are presented in Table 2, 

Scoring of each profile led to the following 
results: The schizophrenic group had a mean 
Score of 15.8 and the control group had a 
mean score of 9.3. This yielded a highly sig- 
nificant F ratio of 18.54 for 1, 87 dj. Apply- 
ing a cutting score midway between the mean 
Scores resulted in 70% correct identification 
of schizophrenic Ss and 64% correct identifi- 
cation of control Ss, 


Table 2 


Significant Signs for Differentiating F 
phrenics from Controls Arranged in 
Used for Discriminant Function 


emale Schizo- 
Categories 


Analysis* 
Sign Score Sign Score 
L SS Mf > 48 
D <62 Hs—Mf < 12 
Hy <62 Mf, D-Mf = 12 
I5 Hs-L Z2 Hy-Mf = 42 
D-L =7 Pd-Mf 247 
Hy-L 27 
Pd-L 12 Pu-D Žž 5-2 
Pi-—D 5-2 
Hs-K 22 Pi-Hy = 3 
K4 Hy-K =7 n Sc—Hs 5 8 
Pd-K 212 NEP) D 53 
ae Sce—Hy as S 
[H-P <2 Sc—Pd S3 
D-F 2r SP 5 3 
Miny-r = 2 
Pd-F <7 
^ For scoring individual profiles, add the nu 


signs in each category to obtai 


appropriate weights. 


n five scores, 


mber of significant 
See Table 3 for 


Discriminant Function Analysis 


Inspection of the significant signs et 
that the majority fall into five lari 
Sories: (a) those involving the L scale; lve 
those involving the K scale; (c) those inv y 
ing the F scale; (d) those involving the a 
scale; and (e) those involving the compar sy- 
of neurotic scales (Hs, D, Hy, Pd) wi ra 
chotic scales (Pa, Pt, Sc). The eee 
sistency of these groupings was high. ! s 50 
signs do not fit into these five ae 
easily. These are D, Hy, and Sc-Pt. nich 
were assigned to the category with E 
they had the greatest correlation. D et was 
Were placed in the Z category and Sc-P cales 
placed in the neurotic-psychotic (N-P) n in 
Category. Table 2 has the signs arrange 
these categories, ‘lable, it 

With five categories of signs availa ean 
was feasible to analyze the scores by 1949) 
of a discriminant function (Johnson, able 
The L values obtained are presented ti ed in 
3. A rough Proportional value was uti oo 
the actual computation of results, and 
weights are also presented in Table 3. cation 

For the K weighted profile, the applic e for 
of these weights resulted in a mean qn the 
the schizophrenic group of 58.1 and ne 
control group of 32.1. Using a cutting oup 
halfway between the means of the two B re- 
(i.e., = 46 = schizophrenic identincat on zop 
sulted in 68% correct identification of sc wi 
phrenic Ss and 79% correct ideien im 
control Ss. This result represents a sligh yes: 
provement over the unweighted sign SCO 


Cross-Validation 


. the 

An additional 49 Ss were obtained at es 

same hospital. These were al] admission ¢4 i 
and the diagnostic Procedure coincided 


time with the administration of the MMP! 
Twenty-eight of these Ss had a diagnosis ° 


a 


Configural Analysis of the MMPI of Female Schizophrenics 


Schizophrenia, and 21 had a diagnosis of neu- 
Sis or behavior disorder. 
aoe Scoring of individual profiles with the 
a o muer of signs resulted in an over-all 
of th a tification of Ss of 63%. The use 
D nA iscriminant function weights applied 
apn, Same scores raised the over-all correct 
pe identification to 79%. The F ratio 
which Weighted scores is 22.53 for 1, 47 df, 
h is significant beyond the .001 level. 
at elly improved prediction leads to the 
Arai: that the use of discriminant 
a weights facilitates the prediction of 
A rophrenic diagnosis with these signs. 
a 4 contains a summary of statistical 
ät i all groups utilized. It will be noted 
surpri e mean and SDs for each group are 
valid Singly similar from validation to cross- 
ation, 
et data on female Ss were solicited 
ima a number of other NP hospitals. At the 
T € of writing, three hospitals had responded. 
. € results for these hospitals are combined 
able 4 for easy comparison with the other 
or | The F ratio for these scores was 41.84 
1, 93 df, which is significant beyond the 
cri „level, Slightly reduced efficiency 1m dis- 
-mination is noted from the cross-validation 


e original hospital. 


Discussion 
conte schizophrenic signs obtained from a 
onfigura] analysis of the MMPI profile show 
siderable predictive accuracy and consid- 


Table 3 
Discriminant Function Weights for Predicting 
iagnosis of Schizophrenia with Approxi- 
mations Used in the Study* 


ae 
Category . 
of Signs L Value Approximations 
aa 3 ee 
Ł 074 6 
a —.023 = 
4 014 
My. 012 1 
NP ‘092 7 
thi, Multiply the avama wersue for each category in the 
“i column See ee Erne eee et category, (rom Table 
OF ax, add for a single total score. Those scores which equal 
Diggecced 46 were identified as schizophrenic in this study. 
the “Tent cutting scores may be set in other situations should 


he situati nay bi ; 
ti uation demand quick discriminati tuationsible pa- 
Nts of one or the other eegee nation of all p 


Table 4 


Discrimination Between Schizophrenic and Control 
Groups with Configural Analysis 
(Discriminant function weights—cutting score 546) 


c 
(= 


Correct 
Groups N Mean SD Ident. 
Validation 
Schizophrenic 56 58:1 210 68 
Control 33 321 209 79 
“Subtle” schizophrenic 28 52.8 19.8 64 
“Obvious” schizophrenic 28 63.5 20.6 71 
Cross-validation 
(same hospital) 
Schizophrenic 28 58.1 19.6 82 
Control 21 313 18.9 76 
Cross-validation 
(other hospitals) 
Schizophrenic 61 62.1 21.6 72 
Control 34 334 184 76 


erable stability from sample to sample. This 
methodology appears to offer more promise 
than other approaches for predicting specific 
diagnoses. In addition, the methodology is 
easily adapted to differentiating personality 
variables other than diagnostic categories and 
easily adapted to other tests than the MMPI. 

An optimally controlled predictive study 
would have two features: (a) the MMPI 
results would not be known to the physician 
when he assigned diagnosis, and (b) the 
MMPI would have been administered at ap- 
proximately the same time that diagnosis was 
made. Very few cases in this study fit both 
criteria. Insofar as the statistics are concerned 
the two flaws would seem to counterbalance 
each other, i.e., the physician’s knowledge of 
the test results should artificially inflate the 
number of correct identifications and the in- 
congruence of time between test administra- 
tion and diagnosis should artificially lower 
the number of correct identifications. Fortu- 
nately, two of the other hospitals used in 
cross-validation supplied cases in which the 
test was not used as part of the diagnostic 
process. Unfortunately, these were cases 
which had been on the ward for some time 
and probably included schizophrenics in re- 
mission and other cases whose clinical picture 
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had changed since the diagnosis was assigned. 
Thus the statistic of correct identification 
would be artificially lowered in this instance. 
The over-all correct identification for this 
group of 48 patients was 69%. Since this is 
a low estimate of predictive efficiency as a 
result of incongruence of time between testing 
and diagnosis, it would appear that the physi- 
cian’s knowledge of test results does not 
grossly inflate these statistics. 

The degree of statistical accuracy obtained 
in predicting the diagnosis of schizophrenia 
(approximately 75%) is adequate in itself, 
Intimate knowledge of the cases used makes 
the results more impressive. Those cases which 
were “misdiagnosed” seem to fall into clearly 
defined groups. The control Ss identified as 
schizophrenic fell into several categories: (a) 
flat, unresponsive, inadequate people usually 
diagnosed conversion reaction or personality 
or character disorder; (b) immature and im- 
pulsive people usually diagnosed personality 
or character disorder; and (c) marginally 
psychotic patients who did not give sufficient 
evidence for a diagnosis of schizophrenia. 
The schizophrenic Ss identified as nonschizo- 
phrenic fall into two general categories: (a) 
those who have had a schizophrenic psychosis 
but are partially or entirely recovered from it 
and (b) those who have currently active 
schizophrenic symptomatology but who also 
have many neurotic symptoms. This latter 
group follows a nonschizophrenic pattern of 
hospitalization in that they are sociable, out- 
going people who make quick recoveries and 
are discharged as quickly as the neurotic 
patients. Thus in the majority of instances, 
there appears to be good reason for cate- 
gorizing a particular patient in the wrong 
diagnostic group. Descriptively, the misiden- 
tified patient often resembles patients of the 
other category to a greater extent than he 
resembles the patients of his own group. 

It is quickly noticed that virtually all of 
the significant signs involve neurotic scales 
of the MMPI. The psychotic scales fail to 
predict schizophrenic diagnoses in 
unless their relative height is cont: 
the neurotic scales. Second most 
number of signs are the validation scales L, 
K, F. This appears to indicate that test-taking 
attitude is important in differentiating schizo- 


this sample 
rasted with 
frequent in 
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phrenic disorders from the neuroses and be 
havior disorders. It is interesting that so many 
predictive studies using the MMPI have Pe 
nored the validating scales except for a 
purpose of selecting “valid” records. It woe 
seem that these validating scales are a pee 
of valuable clinical information and show 
not be ignored. j 
The use of discriminant function a 
seems to have been a valuable addition n a 
methodology. Not only has the metho A 
creased predictive efficiency, but it ae, 
more accurate analysis of what signs ee 
best. From the categories of signs, We a 
gain some knowledge of the aspects onan 
performance which differentiate the sC a 
phrenic from the control group. The grove 
signs which receive the greatest weight a, 
trasts the relative levels of neurotic and P 
chotic signs. Thus the female schizophren mg- 
admits to relatively more psychotic sympt© ‘oh 
tology than she does to neurotic symp at 
ogy. On an absolute basis, she does not 4 het 
to more psychotic sympomatology ne E 
neurotic counterpart. Second in order © an 
portance are the L group of signs. It jane 
that the schizophrenic attempts naive 5 
tion. She tries to conceal symptomatology 
a neurotic variety from herself and alee 
others. Frequently, this goes into a den 
illness syndrome, and the patient is us the 
described as “lacking in insight.” Third oil 
F group of signs. These contrast the neu onic 
scales with the F scale. The schizophren 
patient shows relatively more cones, of 
inattention as compared to the nun ate 
admitted neurotic symptoms. Once again ae 
is not significant difference in the F s 5 
alone between the groups. The fourth sé tic 
items contrasts the Mf scale with the nein ag 
scales. The schizophrenic patient shows ™ 5 
masculine attitudes in the absolute sense ti 
well as relative to the amount of ae 
symptomatology expressed. The fifth ona 
of signs contrasts score on the K scale, W A 
measures a subtle form of defensiveness, W ai- 
several of the neurotic scales. Taken he 
vidually, each of these signs shows that Sue 
schizophrenic female is being more defens!¥” 
in relation to the number of neurotic syor 
toms expressed. Nevertheless, the discri 
nant function weight is negative, indicati” 
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oe in combination with the other categories 
aa this subtle defensiveness is more pre- 
En ie “4 Nonschizophrenia. The general rea- 
that e this reversal appears to be in the fact 
N K as individual scales are highly 
te al ed and the Z and K categories of signs 
aei. highly correlated, both measuring 
Food E akin to defensiveness or saying 
Bears Ings about oneself. The situation ap- 
ae to be similar to what often occurs in 
Moved analysis. After the first factor is re 
well è two highly correlated measures might 
Correlate negatively with each other. 
is rasiveness, as measured by the K scale, 
ae to represent more potential for 
ee Ment in the patient than is defensive- 
ied Measured by the Z scale. Perhaps a 
see way of expressing it is that the Z scale 
ms to measure blind denial of reality, while 
€ K scale appears to measure more subtle 
oe eve defenses against reality. K thes 
uni complex scale than Z and the only 
ique contribution the K category of signs 
r to make when in combination with the 
er signs appears to be in an opposite 
ae from when the K category is taken 
ob: Ne. This result is in accord with clinical 
Servation. 
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Summary 


1. Sullivan and Welsh’s approach of con- 
figural analysis was applied to the MMPI 
profiles of female schizophrenics and controls 
in an NP hospital setting. A scale of signifi- 
cant signs was developed with these validating 
groups. 

2. The significant signs were grouped into 
five a priori, logical categories and subjected 
to discriminant function analysis with sig- 
nificantly improved predictive efficiency. 

3. The weighted sign scores were then 
cross-validated in the same hospital and in 
three other hospitals with approximately 75% 
accuracy in discriminating schizophrenics 
from controls. 

Received September 25, 1958. 
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ANXIETY INDICES IN SAME-SEX DRAWINGS OF 
PSYCHIATRIC PATIENTS WITH HIGH AND 


LOW MAS 


THOMAS E. HOYT? Anp MARTIN R. BARON 


Kent State University 


Since the publication of Buck’s 
1950) and Machover’s (1949) monographs, 
the House-Tree-Person (H-T-P) and Draw- 
a-Person (DAP) have become instruments in 
common use by the clinical psychologist. This 
use has been accompanied by many studies 
concerning the reliability and validity of the 
projective devices, A recent article (Swenson, 
1957) ably summarizes the evidence to date, 
most of which leaves serious doubts regard- 
ing the validity of many hypotheses con- 
cerning the meaning of drawing characteris- 
tics. Despite these findings, many writers feel 
that the technique holds promise. 

In suggesting possible uses of the H-T-P, 
Buck (1948) has pointed out some character- 
istics of the “person” drawing which are often 
noted among patients clinically diagnosed as 
anxious. Similarly, Machover (1949) has spe- 
cified in the use of the DAP those elements 
in pictures which in her clinical experience 
are indicative of anxiety. In addition, they 
both mention characteristics of drawings 
which they believe indicate personality char- 
acteristics generally thought to be associated 
with anxiety. The purpose of this study is to 


compare the frequencies of anxiety indices in 
psychiatric patients clas: 


nonanxious on Taylor’s 
Scale (MAS) (Taylor, 19 


Indices Investigated 


(1948, 


Table 1 lists all th 


e characteristics of 
human figure drawings 


which Buck and/or 


1 This study constitutes a portion of a thesis per- 
formed under the direction of the second author in 
partial fulfillment of requirements for the M.A. 
degree at Kent State University, August, 1955. 

2 Formerly at State Bureau of Vocational Re- 
habilitation, Youngstown, Ohio. Now deceased, 
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SCORES * 


Machover believe show anxiety; Table dr 
characteristics indicated by Buck „an n 
Machover to be related to personality ort 
considered by the principal author to be w 
checking as potential anxiety en ar 
characteristics listed in Tables 1 and 
investigated in the present study. n 

Evidence from other investigations oy 
ing the validity“of these indices will be 
sidered at a later point. 


e 


ard- 


Criterion Measure 


A ith 
The objective measure of ge HT 
which the various anxiety indicators lis dy is 
Tables 1 and 2 are compared in this am 
the Manifest Anxiety scale (Taylor, elec! 
Designed not as a clinical tool but to he a 
subjects for experimental groups, the te pre 
been employed to select extreme KONP gn 
sumably in regard to anxiety; perfor foun 
measures for these groups are usually with 
to differ (Taylor, 1953). In cage an 
the use typically made of the MAS, hig pres” 
low anxiety groups were selected in me the 
ent study, and a tally then made 0 


Table 1 qin 
“ vestigate! 
Characteristics of “Person” Drawings Investiga 


3 4 /or 
the Present Study and Considered by Bue 
Machover to be Indicators of Anxiety 


hover 
Characteristics of Buck Hartree 
Drawing Reference Re 

Placement (upper left- 

hand corner) (1948, p. a a 
Type of line (faint) (1948, p. 3 Al 
Reinforcement (1948, p. 368) co P: 98) 
Shading (1948, p.377) (1949, P: 79g, 
Erasing (1949, pP- 


Anxiety Indices in Drawings of Psychiatric Patients 


449 


Table 2 


Characteristics of “Person” Drawings Investigated in the Present Study and Considered by Buck and/or 
Machover to be Indicators of Personality Attributes Other Than Ansiety 


Characteristic of Drawing 


Personality Attribute 


Machover 
Reference 


Buck 
Reference 


“Type of line (faint) 
“Erasing 


Size (small) 


Conflict 


Tnadequacy 


Relative s; 
tive size of head to figure Rel 
Si Power 
ize of head 
Body Impulses 


Omissi 
Missions 
i Helplessness 


Guilt 
Bod Conflict 
o a A 
Y area out of proportion x 
Lack of Insight 
Poor Reasoning 


~ _ 


Timid; Uncertain; Self-effacing 


ative emphasis on Intellectual 


Social Dominance and Control of 


Shallow Emotionality 


(1949, pp. 95-96) 
(1948, p. 380) 
(1948, p. 370) 
(1950, p. 22) 

(1949, p. 36) 


(1949, p. 36) 


(1948, p. 367) 
(1949, p. 62) 
(1949, p. 97) 


(1949, p. 91) 
(1949, p. 91) 
(1949, p. 91) 


a crea, 

The characteristics type of line and erasing are al 

hu 

ae of anxious and nonanxious subjects 

r: š aying the various anxiety indices in their 
awings, 


Method 
Subjects 
pareser drawings of institutionalized 
TpeN are used as the basis of this study. 


Who Ss were neurotic and psychotic women 
Ceiyj Were new admissions to Woodside Re- 
a ing Hospital at Youngstown, Ohio between 
Rant and June 1955. Tests were admin- 
a almost weekly during this period h 
after that the Ss would be tested shortly 
ai admission. The selective factors required 
of they be: (a) between 20 and 65 years 
a (b) able to read and write; and 
lig 2 sufficient state of awareness and a 
Rist), (as judged by the resident psycholo- 
to participate as Ss. 

rj total of 125 women was tested, but for 
tir S reasons, such as illness, incomplete 
s wee etc., 13 were eliminated. The 112 
o ies divided into three groups according 
eir MAS scores. The 27% with the high- 
on and the 27% with the lowest scores 
5 used for this study. This resulted in 
M Ss, one group of 30 with a score on the 
S of 1 to 12, to be called “low anxiety,” 


iy 


so included in Table 1. 


and one group of 30 with a score on the 
MAS of 25 to 43, to be called “high anxiety.” 


Procedure 

Testing was done in a group situation, the 
number of Ss in the group being from 5 to 
15 women. The MAS was administered to 
the Ss, then the same-sex drawing test. Fol- 
lowing this, a group Rorschach was given. 
Finally, Ss were asked to draw a second figure 
of their own sex. The data herein considered 
concern only the first drawings. 


Scoring and Reliability 


An attempt reported elsewhere (Hoyt: 
1955) was made to devise a refined scoring 
manual to measure the various possible 
anxiety indices from the drawings. All draw- 
ings were first coded so that the examiner 
would not know which pictures were drawn 
by high and which by low anxiety Ss, and 
then scored on one index at a time Sco 
values usually from zero to three wees on 
signed.’ Reliability of this scoring seasons 


5 < 
Pe ge tel pide (1955) original study was to 
Xistence of significant relati i 
ion 

Siege peated amounts of various melee A 
= aan Ha scores. To do this, he utilized a 
pa Hs p to determine for each index which way 
& amounts of “presence” would correlate 
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Table 3 


Proportion of Anxious and Nonansious Ss Displaying 
Various Characteristics in Their Drawings, with 
Chi Square Values and Levels of Confidence 


Proportion 
Displaying 
Characteristic 
__ Level 
Characteristic of Non- Chi of Con- 
Drawing Anxious anxious Square fidence 
Placement (upper 
left-hand corner) .433 167 3.88 05 
Type of line (faint) .167 133 0.00" 1.00 
Reinforcement -700 533 1.20 30 
Shading 433 400 07 -80 
Erasing .833 .867 0.00* 1.00 
Size 433 167 3.88" 05 
Relative size of 
head to figure 533 633 62 50 
Size of head 433 167 94" 40 
Omissions 400 233 1.228 30 
Body area out of 
proportion 467 


* Corrected for continuity. 


was determined by computing for each index 
the mean absolute difference between the 


utilizing two 
iability. Fol- 
dex, the data 
significance of 


was employed on all tables 
an expected value less than 


best with the MAS. He ho 
sized indices and scoring pi 
pendent sample; however, a new sample large enough 
to perform an adequate test of the utility of his 
scoring procedure could not be obtained. Because of 
this unfortunate characteristic of Hoyt’s (1955) de- 
sign, his scores have been dichotomized into what 
might well be considered a priori categories, 


where there was 
10. 


ped to test the hypothe- 
tocedures on a new inde- 


Thomas E. Hoyt and Martin R. Baron 


Results 


The proportion of anxious and pons 
Ss displaying the various indices in age 
drawings, the chi-square values for each n ble 
and the levels of confidence appear in k Ss 
3. In view of the fact that virtually af i 
shaded the hair of the person in the drawni 
shading was counted only for body sha E 
Two of the indices were found to differen. S 
significantly between high and low anxi 
groups on the basis of the MAS oriten 

Placement in upper left-hand corner F 
small size were found to be the, ed 
valid indices according to the MAS crite 
with chi-square values significant at pape, 
level of confidence. Reinforcement and 0 de- 
sions were found to differentiate to Sora na 
gree between high and low anxiety gr rde 
but the chi-square values would be ero ther 
30% of the time by chance alone. The ‘a 
indices were found to discriminate not s of 
between high and low MAS groups. Tht ” pe 
10 anxiety indices, only two are foun oa 
valid at the .05 level when separately a 
ployed utilizing the MAS as a criterio 
anxiety. i ant (0 

It is perhaps worthwhile at this Po the: 
re-examine Buck’s and Machover’s ae f 
ses. Are they saying that the presa 
shading (as an example) is indicat} uari 
anxiety? If this is so, then our ehi ae - 
test of each index separately has been ee 
priate. Or are they saying that anxiety į the 
be indicated in a number of ways; tha! cts 
presence of any one of many indices Presult® 
anxiety? If the latter is true, then the a a 
reported in Table 3 are not a fair Ri s 
their hypotheses. The data reported in - that 
4 and 5 are relevant to the hypothesis e of 
that any S, whose drawing has any on d 
the characteristics indicated by Buck more 
Machover to be indices of anxiety, 15 draw 
likely to be anxious than is an § whose 
ing lacks any of these characteristics. rori 

Machover’s (1949) indices are reinf e it 
ment, shading, and erasing. None of thes®,, 
will be recalled, is significantly related tO an 
criterion. A count of the number of high ic 
low anxiety Ss, shown in Table 4, whose Pa 
tures contained any one of these indin 
showed 87% of the anxious and 93% oft 
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Anxiety Indices in Drawings of Psychiatric Patients 


es Ss to have displayed one of these 
aracteristics in their drawings. Because the 
portion of cases showing at least one of 
“ain characteristics is so close to 1.00, chi- 
a o mputatioi is unjustified. It is clear 
of o the figures, however, that the presence 
Mor ne of Machover’s indices is not found 
Ss e frequently in anxious than nonanxious 
ed anxiety indices mentioned by Buck 
and ¢ 1950) are placement in upper left- 
and aED light type of line, reinforcement, 
relate ne Of these, the first is significantly 
table to our MAS criterion. A contingency 
if the (Table 5) was constructed to determine 
Was € presence of any of Buck’s four indices 
“S more likely to be found in drawing of 
as than those of low MAS Ss. It is 
of able here, too, that a very high proportion 
at Se anxious and nonanxious Ss displayed 
in, least one of Buck’s indices in their draw- 
indi Clearly, the presence of any one of his 
ces does not differentiate high and low 
AS Sroups; chi square equals zero. 


Discussion 

at Was apparent to the authors at the out- 
of this study that there might very well 

di little correspondence between anxiety, 
nically diagnosed, and manifest anxiety, aS 
ancsured by Taylor’s MAS scale. Some might 
Ree that skilled interpretations of drawings 
hae e human figure would be @ better cri- 
k ‘on of anxiety than the MAS, and thus a 
relation between MAS and drawing inter- 
‘etations would indicate the validity of the 
si S. Considering that the present data are 
Mply correlational, it is noteworthy that 8 
st the 10 anxiety indices investigated in this 
Udy were found not significantly related to 


Table 4 


y . 
; "portion of Anxious and Nonansious Ss Displaying 
and Not Displaying Any One of Machover’s 
Anxiety Indices (Reinforcement, 

Shading, and Erasing) in 


— ‘Their Drawings 2 r; 
Not, 
ii Displaying Displaying 
eis 867 133 
Aona ‘933 ‘067 
=e 


491 


"able 5 


Proportion of Anxious and Nonanxious Ss Displaying 
and Not Displaying Any One of Buck’s Anxiety 
Indices (Placement, Type of Line, Rein- 
forcement, and Shading) 


Not 

Displaying Displaying 
Anxious 867 .133 
833 167 


Nonanxious 


Note.—(x? = 0). 


the MAS criterion. It is perhaps more worthy 
of note, on the other hand, that two of the 
indices, one of them specifically indicated by 
Buck as an anxiety indicator, are significantly 
related to the criterion. Since it is unlikely 
that 2 of the 10 indices could be related to 
the criterion (at the .05 level of confidence ) 
by chance, the authors take the position that 
the interpretations of the drawings and MAS 
indicate more in common than might be ex- 
pected on a chance basis. 

It is perhaps worthwhile at this time to 
compare the evidence obtained in this study 
with other findings described in the literature. 
Table 6 is presented to facilitate the com- 
parison. 

Here it can be seen at a glance that, accord- 
ing to evidence prior to this study, only two 
characteristics are related to anxiety: size and 
size of head. Of these, size was also found 
significantly related to our MAS criterion. In 
addition, placement was found before not to 
be related to anxiety, whereas in the present 
study it was related to MAS scores. Thus, the 
findings of the present study are partially in 
agreement with those reported in the litera- 
ture, and point up the relevance of placement 
where such relevance had not been previously 
confirmed. 

Using the MAS criterion, it becomes appar- 
ent, as shown in Tables 4 and 5, that the 
presence of any one of the anxiety indices 
(either of Machover or Buck) does indicate 
anxiety; however, it is also true that the 
indicate nonanxiety just as often. One eee 
interpretation of this finding is that in clini- 
cal experience one may be tempted to remem- 
ber only positive evidence and as a conse- 
quence to continue employing an instrument. 


Table 6 


Characteristics of “Person” Drawings Investigated in 
This Study as Possible Anxiety Indicators with 
the Nature of Prior Findings and Present 
Findings Indicated Separately 


Present 
Characteristics Prior Findings Findings 
Placement negative (Goodman & positive 
Kotkov, 1953) 
‘Type of line negative (Royal, 1949) negative 
Reinforcement negative (Royal, 1949) negative 
Shading negative (Royal, 1949) negative 
Erasing negative (Goldworth, negative 
1950; Royal, 1949) 
Size positive (Lehner & Positive 
Gunderson, 1953) 
Size of head and positive (Goldworth, negative 
relative size of 1950) 


head to figure 


Omissions positive (Goldworth, 
1950) 

negative (Goldworth 
1950; Royal, 1949) 

positive (Goldworth, 
1950) 

negative (Prater, 
1950; Royal, 1949) 


negative 
: 


Body areas out 


negative 
of proportion 


In the light of the present evidence, it is 
Suggested that attempts be made to determine 
if the presence of any of these indices is more 
common among Ss clinically diagnosed as 
anxious than among those diagnosed as non- 
anxious. If data comparable to those in Tables 
4 and 5 are obtained, using clinical criteria, 
virtually all Psychiatric patients are anxious, 
and the presence of these indices is not par- 
ticularly worthy of note except as possible 


sources of suggestion to the therapist regard- 
ing possible anxiety sources. 


Summary 


The purpose of this study was to determine 
whether various indices clinically employed 
by Buck and/or Machover to diagnose anxiety 
were valid, using the Taylor Manifest Anxiety 
Scale (MAS) as a criterion. Other indices 
were also investigated. 

The indices investigated wer 


e placement in 
the upper left-hand corner of 


the page, faint 
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type of line, reinforcement (i.e., vetracin 4 
shading, erasing, size, relative size of head 4 
figure, size of head, omissions, and body area 
out of proportion. : ‘ 

The’t ‘i Ss who were employed in ae 
study were female admissions to a mena 
receiving hospital. These Ss were given it 
MAS and then asked to draw a figure of be A 
own sex. The highest and lowest 27% of e 
112 Ss, as determined by the MAS, pa 
classed respectively as anxious and nanat i 
and the drawings of these 60 Ss independents 
scored for presence or absence of each in be 

Findings showed placement and size to ‘ 
significantly related to MAS scores. Non 
the other characteristics significantly gil us 
entiated between the anxious and nonansi0 
patients. 
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NOMOGRAPHS FOR COMPUTING THE “VALIDITY” OF 


WISC OR WECHSLER-BELLEV 


UE SHORT FORMS 


CECIL BRIDGES 


Department of Pupil Services, 


Bie the course of the selection of a short 
Child of the Wechsler Intelligence Scale for 
inst ren (WISC) to be used as a screening 
of rument in special education, the problem 
Calculating numerous correlations of possi- 
5 short form subtest combinations with total 
ore arose, McNemar (1950) has shown that 
the = elation between abbreviated forms o 
Sco Wechsler-Bellevue (WB) Scale and tota 
Tic Te may be calculated from correlation mat- 
€S presented by Wechsler (1944) in his 
aul. This is also true of the WISC 
(Wechsler, 1949). l 
but, €re are several instances in which com- 
ation of such “validity” coefficients May 
© useful. For instance, in selecting @ short 
Ea Screening instrument from subtests, fac- 
4 YS other than WB short form correlation 
rath total score might enter into the selection 
fa of administration, etc-), and the “va- 
‘dity” of the chosen battery might not be 
op P8 those given by McNemar. In the case 
of the WISC no such coefficients are avail- 
able, 
a using McNemar’s formula, 
ee require a desk calculator if reasonable 
Deed is desired. The nomographs presented 
ere were devised to eliminate all calculations 
except addition necessary to obtain the sum 
the correlations of the tests and the sum 
°f their intercorrelations. One nomograph is 
nsed for computing the short form correlation 
With total score when the short form consists 
°f two, three, or four subtests. A second 
J OMograph is used for computing the corre- 
ation when five, six, or seven subtests are 
Used. With the use of a nomograph, calcula- 
‘on is considerably faster than with a desk 
calculator. 
To use the nomograph, first find the sum of 
e rs for each selected subtest from the 


the calcula- 


Oklahoma City Public Schools 


correlation matrix presented in Wechsler’s 
manual (there will be nine of these r’s for 
each test) and add these sums. Next find the 
sum of the intercorrelations between the se- 
lected subtests. 

The horizontal scales on the nomograph 
correspond to the sum of the 7’s (the first 
quantity mentioned above). The vertical 
scales on the nomographs correspond to the 
sum of the intercorrelations of the chosen 
tests. The curved lines in the body of the 
nomograph correspond to the correlation be- 
tween the short form and total score. Thus, 
to find the correlation of the short form with 
total score, find a point on the appropriate 
horizontal scale corresponding to the sum of 
the 7’s (interpolate if necessary) and lay a 
straight edge through this point perpendicular 
to the scale. Find a point on the appropriate 
vertical scale corresponding to the sum of the 
intercorrelations, and lay a straight edge 
through this point perpendicular to the scale. 
If the intersection of the two perpendiculars 
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Fig. 2. Nomograph for computing the correlation 
of short form with total score when five to seven 
subtests are used. 


falls on one of the contours of equal correla- 
tion, the value of 7 with which that line is 
labelled is the correlation of the short form 
with the total. If the point of intersection falls 
between contours of equal correlation, interpo- 
lation is necessary. The correlation found will 
usually be correct in the second decimal place 
if interpolation is done carefully.2 The nomo- 


* There is a negligibly small constant error of about 
74 of 1% involved in the use of a single set of nomo- 
graphs for both tests. The use of a single set of 
nomographs is possible because the quantity in the 
first radical of the denominator of McNemar’s equa- 


Cecil Bridfa 


graphs are strictly applicable only to m 
populations of Wechsler’s (1944) Table he 
and Wechsler’s (1949) Table V. Because ‘ 
subtest correlations are not perfectly reliable, 
there is some capitalization on chance wie 
a battery of subtests is selected for nae 
correlation with the total, and a slight a i 
age of this correlation would be expected 
cross-validation. an 

Because of a small arithmetical enoa 
McNemar’s special formula (Howard, 19 k 
WB “validities” obtained with these nomo 
graphs will be slightly higher than on 
sponding “validities” presented in McNem 
original article. 
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FORCED ASSOCIATIONS, SYMBOLISM, AND 
RORSCHACH CONSTRUCTS 


JOSEPH F. RYCHLAK 


Washington State University 


An interesting and problematical aspect of 

Orschach test interpretation is that of con- 
tent analysis. Is it legitimate to base hypothe- 
Ses about personality on the content of a 
Subject’s perception, or should the clinician 
limit himself to the more rigorous procedure 
of formal scoring? Piotrowski (1957, p. 324) 
Notes that the latter practice is on the grins 
and that psychologists are relying increasins'y 
on content analysis. 

Rorschach (1943, p. 207) suggested et 
Content of inkblot interpretation might sp 
a meaning of its own, but believed be phe 

€termined primarily by significant re a R 
ships existing between form and conten ae 
review of representative texts On ped 

Orschach interpretation (Ames, hai ea 
Metraux, & Walker, 1954; Beck, tach. 
“reud, 1938; Lindner, 1952; Roe 
1943; Sarason, 1954; Schafer, Ee ee Tot 
that none actually denies the Poss! by thee 
Content responses carrying Asean ee hasty 
Wn. Usually the author cautions agai penne! 
Symbolic interpretations and st eee 

at content is only one of severa 
ay probably Be hae context of the 
any given protocol. Often t sth the implica- 
Content response is stressed, Wi varies wit 
tion that the meaning of the rHS how- 
the former. Following such TR vpothesize a 
ever, several authors 80 on act response 
given meaning for 2 Fraqpern, 1953, P. 37; 
(Allen, 1954, p. 85; Halpel™ Holt, 1954, 

lopfer, Ainsworth e984) p. 120). Such 
PS8; Phillipe Sn d to a specific area of 


Proposals may be relate 


é always the case. 
a card, but this 1$ not pretations come from? 


i T] 
Where do these inie usually cited as the 
ini jenc! ? sonir 
inia cet However, since clinicians do 
ajor source. ae 
not work in theoretic? 


prising to find that many of the symbolic 
interpretations made on the basis of content 
stem from the psychoanalytical literature 
(Piotrowski, 1957, p. 324). A more basic 
question is how valid is it to generalize a 
content interpretation based upon past clinical 
cases to the present one? Do people really 
ever see the same blot or, more profoundly, 
the same content? How can one check on the 
meaning of a content response? We are prob- 
ably a long way from any conclusive method 
for the testing of content meaning. Osgood 
(1952) has presented a method which may 
eventually develop into an adequate test for 
the meaning of symbols. Some would argue 
that this will never be possible on a large 
scale and that clinical evaluation will remain 
the best bet. Although agreeing in spirit with 
the latter position, the author would like to 
describe a method for testing, in gross fashion, 
the relationship between a given construct and 
a given meaning. 

The method employs a simple forced asso- 
ciation between arbitrarily chosen Rorschach 
constructs (Clouds, Fire, etc.) and a series 
of six “meanings” (Love, Anger, etc.) often 
assigned to these constructs (rightly or 
wrongly) by clinicians. No claim is made as 
to the actual meaning of a construct; all the 
method aims to do is assess whether or not 
people can agree in their choices between 
some of the meanings often assigned by clini- 
cians. It is also of interest to see, given a 
choice between various meanings, which one 
will be most frequently chosen. 


*The author would like to thank the following 
people for their help in arranging Ss and analyzing 
the data: Julian C. Davis, Florida State Hospital; 
Barron B. Scarborough and Charles Moos of Florida 
State University; and John W. Neff, Clinical Direc- 
tor, Pueblo, Colorado Mental Hygiene Center. 
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A construct is seen as a cognitive abstrac- 
tion from sensory stimulation, which may 
have more than one circumscribed pattern 
of stimulation as a referent. The construct 
“foggy,” for example, can refer to an atmos- 
pheric condition or a state of mind. Since the 
former association is more frequent, we use 
the term “symbolical” to describe the situa- 
tion when the latter association is utilized. 
Osgood (1952, p. 200) differentiates Signs 
from objects, and the distinction can help in 
clarification here. An object is any pattern of 
stimulation (from a hammer to a gust of wind 
in the face) which evokes reactions on the 
part of an organism. A sign is any pattern of 
stimulation other than the object which evokes 
reactions relevant to the object. The theoreti- 
cal position taken here is that Rorschach con- 
structs are such signs. If Rocks symbolize 
Security (Halpern, 1953, Pp. 37) what the 
clinician must mean in this suggestion js that 
a meaning is conveyed by the construct Rock. 
He—the clinician—has learned to identify 
this less frequent association which people 
have between feelings of security (object) and 
tocks (sign). The process of Projection would 
be the opposite side of the coin: a person has 
need of security (object), hence presumably 
chooses from the amorphous stimulus of the 
inkblot a symbol (sign) typifying the need. 

The present study is based upon a social 
Psychological rationale. It is assumed that if 
constructs chosen from the Rorschach have 
the meanings often ascribed to them by clini- 


Method 
Instrument 


A forced association test, cons 
pages and devised for group us 
istered to the Ss. Each page 


isting of three 
e, Was admin- 
dealt with the 
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following 12 constructs: Boots, Smoke, A 
(animal), Mask, Fur, Fire, Clouds, Ro A 
Hair, Bat (animal), Island, Mountains. 
description of each page follows: 4 
Page 1: Constructs were ranked at the ene 
side of the page and to their right were two ee 
of blank spaces. The columns of blanks wert, it 
Positive Meaning and Negative Meaning, ml 
Possible for an S to assign a positive or nega 
; t. 
E Ps pal arranged so that, e 
was followed by three meanings: Ambition, ning 
and Security. A check space preceded each mig o 
so that a construct could be associated with e? e- 
the three alternatives by simply placing a chee 
fore the meaning “coming closest” to the cons con- 
Page 3; Similar to page 2, except that each sion, 
struct was followed by the meanings of Depres 
Fear, and Anger, at 
The Rorschach constructs were selected s 
random from those frequently reported iy e 
taking the test. Two points need to be a all, 
concerning the list of meanings. First © ther 
as discussed in the introduction, in oe 
Context they could serve as constructs. ote 
are arbitrarily “meanings” here only ate e 
of their representativeness as frequently Sees 
interpretations of the constructs. For this ! ri- 
son, the Z defined each meaning in the exP re 
mental instructions to Ss, but did not pa 
the constructs, Secondly, the meanings dur- 
chosen as a result of extensive pretesting d it 
ing which it was discovered that Ss ee 
difficult to differentiate between Thep ger 
having similar connotations, such as an i 
and Hatred, or Sex and Love. Of eae 
is possible to think of Love as an age 
or reflecting Security, but it was ing 
through interviewing Ss that the pene 
eventually chosen were less likely to ee 
fused than those of, e.g., Anxiety and | n 0 
Psychologists may have a clear concep a Ss 
the differences between the latter, bu 
rarely do. 0 
Consequently, the final instructions bse 
Phrased as to make a broad inclusion of ke 
notations under a meaning possible. Pas' er 
instructions included the following brief ov’ 
view by the E: a 
Ambition meaning of course the desire to get abe? 
or improve one’s circumstances . , , . Love ree e 
all kinds of warm emotions or feelings toward 0 ini 
people or other things .. | and Security mean 


3 «ances 
the feeling of safety and protection one experien 
in certain situations. 


S 


ye 
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Page 3 had the following clarifying remarks: 


Depression meaning of course a feeling of sadness 
and gloom, a sort of “what's the use?” notion . . . - 

car means the feeling of fright we get when some- 
thing scares us or worries us and makes us anxious 
bales and Anger is the kind of irritable feeling of 

ing mad or burned-up at someone or something. 


No suggestions regarding the definition of 
Constructs were given, except to clarify that 
two of them (Bear and Bat) referred to 
animals, 
__ Thirty-five Ss (20 female, 15 male) attend- 
ing an undergraduate psychology course were 
given a one-week test-retest reliability check, 
evaluated with the binomial expansion (Ed- 
Wards, 1957, pp. 43-48). The mean CA of 
ese Ss was 22.6, and their mean educational 
level was 14.9. In order to reach the .05 level 
o significance, an S must match his initial 
choice, on retest, at least nine times for page 
0 and at least six times for pages 2 and 3. 
n this basis, 97% of all Ss reached the .05 
‘vel on page 1, 97% reached it on pase 2, 
and 86% reached it on page 3. To demon- 
Strate the upper limits of reliability, a more 
"orous level of significance can be pointed 
to. For example, 51% of the Ss had 11 or 
More matches (.003) on page 1; 74% had 
eight or more (.007) on page 2; and 40% 
Jd eight or more (.007) on pase 3. Thus, 
o appears that constructs and meanings can 
be associated with an acceptable degree of 
Consistency, 


Subjects 


The following groups of Ss were tested 
(N = 160): 


University Students: = 67 (30 female, 37 male); 
Macan CA 21.4; mean education 14.2 CA 27.3; 
= Extension Students: = 22; mean wit 417? 
Can education 12.8 a5 
Female Extension Students: 7# =25; mean CA 40.2; 
can education 14.8 A 
Male Mental Patients (MPs): n=23; mean = 


F, 2.0; mean education 11.6 
emale MPs: n= 23; mean CA 40.1; me 
tion 11.8 


an educa- 


_ The university students were drawn from 
troductory psychology classes. Male exten- 
Sion students were USAF personnel, attending 
night classes at a nearby airbase. The female 
extension students included several preschool 
teachers. The MPs were in residence on the 
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receiving wards of a State Hospital. Although 
some were bizarre, in general they were not 
the severely regressed type of patient. The 
only criteria of selection adhered to in choos- 
ing the MPs were that they have either (a) 
a high school education or (b) two years of 
high school and score within the average range 
of intelligence (or above) on a standard IQ 
test (Wechsler or Binet). All forms of diag- 
nostic categories were included, from charac- 
ter disorders through neuroses and psychoses. 


Procedure 


The study was structured for Ss as a “sur- 
vey of concept meaning.” They were told that 
the E was interested in knowing what most 
people “associate—or connect—with certain 
concepts.” All testing was done in groups, but 
the MP sample involved much more intimate 
groupings of two to eight Ss. After checking 
a positive or negative valence on page 1— 
presented through an example in the instruc- 
tions as roughly equivalent to liking or dis- 
liking the construct—Ss went on to complete 
pages 2 and 3 as a group (i.e., all Ss com- 
pleted each page before another was begun). 

Only one of the three alternative meanings 
could be checked for each construct. Ss were 
told that there were no right or wrong an- 
swers, and that if none of the three meanings 
fitted exactly they were to check the one 
coming closest to what the construct sug- 
gested. Questions and complaints were occa- 
sionally raised, but on the whole, test ad- 
ministration ran smoothly. Only two of the 
original group of MPs had to be dropped 
from the sample because of a refusal to co- 
operate. 


Results 


The first question to consider is—are there 
consistencies in forced associations between 
constructs and meanings? Table 1 contains 
the valances and meanings most frequently 
associated to the constructs by the total sam- 
ple, evaluated with chi square (Edwards. 
1957). The percentage of all Ss (N= 160) 
choosing a valence and meaning is listed. 
Note that in some cases, although statistical 
significance exists (.05 level or greater), no 
clear-cut choice between meanings associated 
to a given construct is possible. 
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Table 1 
Percentage of Choices: Valences and Primary Associations (N = 160) 
Page 2 Primary Page 3 Pirai 
Valence Association Associatio: 
a F o of N 
% of N % of N 70 sine 
Construct Value Choosing Mng. Choosing Mng. Choo: 
; F 36 
Pos. 74 Sec. 61** Anger }s 
Boots ne a0) 
Smoke N.S. N.S. Fear aye 
Bear Neg. 58* NS. Fear tb 
Mask Neg Oe Amb, 42) m Fear t)ar 
Sec. 4j Depr. Soak 
Fur Pos. 86** N.S. Depr. Za 
Fire NS. Amb. 38) & Fear 4 
Sec. 41f ar 
Clouds Pos, tel Love 49** Depr. 7 
Rocks Pos. 70** Sec. 63** NS. ae 
Hair Pos. 82** Love 64** Depr. pa 
Bat Neg 82** Amb. 57** ee ae 
Island Pos. 86** Love 50** Depr. 39 
Mountains Pos. 91** N.S. Fear 33 |= 
r. 
r P an a). Dep a. 


Note.—N.S. means “not significant.’ 
* Significant between .05 and .01 level 
* Significant at or beyond .01 level, 


A reasonable second question revolves about 
the influence of valences upon associations. 
Did Ss viewing a construct as either positive 
(ie., roughly equivalent with “liking”) or 
negative significantly alter the pattern of as- 
sociations noted when this distinction was not 
taken into consideration? Table 2 contains a 
valence breakdown, giving the number of Ss 
(n) who assigned either positive or negative 
to a construct and, of these, the percentage 
who selected the listed meaning in their 
forced associations. Note that the meanings 
most frequently associated to a construct are 
remarkably similar in both tables. Moreover, 
the percentage of Ss choosing a given mean- 
ing remains roughly equivalent. Interesting 
differences can be pointed to. For example, 
the construct Bat no longer retains its asso- 
ciation with Ambition when we consider the 
choices of only those Ss (28) who checked 
Bat as having a positive valence. A finding of 
this sort suggests that, at least in some cases 
significant differences resulted because Ss were 
choosing the alternative meaning least dif- 


ferent than a construct, and did this with 
consistency. 


The next point to consider concerns aa 
group differences that might be expec: ee 
the basis of group classification. Do MPs ther 
“private meanings” differing from the tbe 
stoups which might account for some Of : 
variance noted in the tables? It was a 
that only the broad distinctions of ea: 
mal and male-female would be of i an pine! 
significance in the present investigation. nless 
breakdowns would not be necessary U the 
significantly different trends were noted ue 
larger comparisons. Consequently, an wnt ed) 
to contrast each group was purposely chec Jes 

Comparisons of the specified sub aah 
revealed no major differences with regar t 
predominant valence or with regard ar of 
most heavily favored associations. Only cenit 
the 72 chi squares computed reached sig K 
cance (.05 level or greater), and of these Sa 
three displayed a difference in predoni 
valence or primary association (i.e, mean ups 
chosen most frequently by either of the gro 
under comparison) . 1) 

For example, a typical finding (.01 lev 
was that although MPs (63%) and norm 
(62%) both associated Security to Rock® 


Pi 


e 


Symbolism and Rorschach Constructs 


EE 82%) were more likely to also 
tended 4 Ambition, whereas MPs (22%) 
Fon fo J choose Love as a secondary associa- 
lence on An example of a relative va- 
(049%) erence (.01 level) is that women 
valence are more likely to assign a positive 
ings t,t Fur than men (80%). Such fnd- 
ha though certainly suggestive, cannot be 
the asized because of the gross nature of 
polling. 

nia three comparisons having differences 
as follone: choice or primary association are 
ach ows: MPs (76%) are more likely to at- 
(43g: negative valence to Fire than normals 
lock (.01 level). MPs (52%) tend to as- 
Wherea Fear to Mountain most frequently, 
Most is normals (43%) associate Depression 
associ requently (.02 level). Women (6276) 
are sae Love to Clouds, whereas men (49 r) 
level), e likely to associate Ambition ( 

T final consideration of interest in 
Mea oi this sort concerns the frequency 5 
Darter categories chosen, disregarding the 
ass ‘cular construct to which they were to be 
e ciated. Do the experimental groups make 
qual use of all meanings, or do some favor a 
hitticular category? Additional tests of sig- 
‘Neance again revealed a fair degree of con- 


a sur- 
of 


4397 


some differences were noted. Male MPs chose 
Security (42%) and Love (34%) most fre- 
quently, whereas normal men selected Am- 
bition (38%) and Security (37%) most fre- 
quently (.01 level). No comparable differ- 
ences were found when contrasting female 
MPs and normal females. However, sex dif- 
ferences did exist. Women, as a group, chose 
Anger (18%) and Fear (47%) as extremes, 
whereas the men had less of a contrast be- 
tween extremes with Anger (24%) and De- 
pression (39%) as their low and high choices 


(.01 level). 
Discussion 


Leaving aside the issue of which particular 
meaning was associated with which particular 
construct, it seems fairly apparent that the 
major prediction of this investigation has 
received some verification. A consistency in 
forced association was noted across such lines 
as sex and mental health. Only three actual 
reversals in valence or primary association 
were noted. The slight inconsistencies be- 
tween groups probably can be attributed to 
chance, although they are explicable when 
taking the groups into consideration. That is, 
women assigning a positive valence to Fur 
more frequently than men is understandable, 
considering the female status implications of 


si Lao. 
'stency concerning primary associations, yet 
Table 2 
Percentage of Choices: Valences Breakdown (V = 160) 
s P 
Positive Valence (n varies) Negative Valence ( varies) 
% of n % of n 
Construct n Mng. Choosing z Mng. Choosing 
Boots 118 Sec. 62** 42 Depr. s3 
Smoke 74 N.S. 86 Fear o5** 
Bear 67 N.S. 4 93 Fear Jye 
Mask 4S Amb. 35), 112 Fear 41) 
Sec. 47) Depr. 38“ 
Fur 138 NS. m 22 Depr. oat 
Fire 70 Sec. ae 90 Fear g2** 
Clouds 133 Love Ret 27 Depr. sre 
Rocks 112 Sec. est* 48 NS. 
Hair 132 Love 28 Depr. 61** 
Bat 28 N.S. si” 132 Rear 71% 
Tsland 138 Love 22 Depr. 64** 
Mountains 146 NS. 14 NS. 


Note—_N.S. means “‘not signi a 
e—NS. ignificant. 

* Significant between .05 and ,01 levels- 
** Significant at or beyond .01 level. 
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a fur coat. Or, the fact that male MPs use 
Love more frequently than normal males 
(who use Ambition) when associating to the 
constructs makes sense in light of the former’s 
circumstances as hospitalized patients in need 
of care, etc. 

On a more theoretical plane, the results are 
in line with a sociopsychological approach, If 
constructs have a symbolic function then, un- 
less the clinician has truly extensive time in 
which to interview an individual to determine 
unique aspects of his symbolic activity, it 
must be assumed that this is a socially learned 
function, carried by cultural influences. The 
test or dream interpreter, as a member of this 
culture and by assuming the proper set to ob- 
serve, can identify these “symbols” in the 
fashion outlined in the introduction of this 
paper. By studying the tables the reader can 
assess for himself the accuracy with which 
his particular bias of symbolic interpretation 
meets the findings. Suffice to say that many 
common interpretations hold. This study can 


say nothing about the actual meaning of a 
construct, 


Summary 


The present research approaches the prob- 
lem of construct symbolism with a sociopsy- 
chological rationale. It is assumed that, if con- 
structs chosen from the Rorschach have the 
Content meanings often ascribed to them by 
Clinicians, then a polling of assorted groups 
should reflect such consistencies in forced as- 
sociations. Assorted groups of Ss polled are 
found to reflect certain consistencies in their 


Joseph F. Rychlak 


x ta ‘ ines 
forced associations, cutting across such ia 
as sex and mental health. The major pre 
tion is considered verified. 
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A NOTE ON LEVIN’S REPORT OF FINDINGS WITH 
PHENOBARBITAL, PROMETHAZINE, CHLOR- 
PROMAZINE, AND PLACEBO 


LLOYD K. SINES 


University of Minnesota 


In view of the many reports in the litera- 
ture and other sources of information relative 
to designing and conducting adequate studies 
m the area of psychopharmacology (Kline, 
1959; Rashkis & Smarr, 1958), there so 
little excuse for the persistence of many 0 
the major tactical and other errors apparent 
in this area of important and copious —, 

Tecent study by Levin (1959), reporte A 

's Journal, exemplifies several such uan 
sary methodological errors. In view of the = 

at reports in the professional gard 
Psychopharmacological studies will unco t- 
edly increase in the immediate future, co 
tinuing efforts must be made to apne a 
Search design and methodolog and, oe 
Maintain high standards for the public 

Such reports. : 

I should like to note two types oi a 
exemplified in Levin's study and, pane ia 
Comment on what appears to be an a 
the author’s interpretation of his own data. 


Methodological Shortcomings i 
ad uniform 


1. The use of an arbitrary a! pai 
Osage of each medication for all pe ened 
e study constitutes the major me oe 

Cal error in the study. This practice ti 
be defended in view of the knowledge a “0 
vidual differences among persons 1” Lae A 
SPonsiveness to various chemical anr P 
n this connection, it has been a | 
Winkelman (1957) that a ratio of tee 
as been found in the individual age ek ong? 
ance of, or reaction to, ataractic a ee 
the present time, the use of an anne os 
Physician’s clinical judgment in the P Se 
Nation and individualization of drug mn 
on a patient-to-patient basis is much pre 


over the practice of employing a single uni- 
form dosage of the therapeutic agents used. 

2. The possibility of bias in the behavioral 
ratings cannot be ruled out in view of the 
fact that the raters may have been aware of 
differences among the groups in the prepara- 
tions which the patients received. That is, 
though it is stated that chlorpromazine and its 
placebo were “similar” in appearance, pre- 
sumably the phenobarbital and promethazine 
preparations were distinguishable in appear- 
ance (and possibly in other ways) from the 
other two agents. Further, it is common 
knowledge that even under the so-called 
“double-blind” regime, ward personnel (and 
raters) are able to predict with high accuracy 
the actual group identification of patients re- 
ceiving alternative therapeutic agents (Hall 
& Dunlap, 1955). It is, of course, not inevi- 
table that such information leads to biased 
judgments of change among patients, although 
it is necessarily a limiting condition in the 
experimental design. The use of standard 
liquid or parenteral modes of drug adminis- 
tration is a desirable (though often impracti- 
cal) procedure aimed toward minimizing pos- 
sibilities for the identification of the specific 
group status of patients on such a priori 
grounds. 

3. An over-all attrition rate of 23% among 
patients originally included in the study ap- 
pears somewhat high and suggests the possi- 
bility that even if the original patient sample 
were a random or representative one with 
respect to the parent population, the final 
analyses (and therefore generalizations) may 
well have been based upon a unique or selec- 
tive sample of subjects. 
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Statistical Weaknesses 


1. Data (and statistical analyses) support- 
ing the conclusion that fewer symptoms were 
observed in all groups at the end of the 
follow-up period than at the beginning of the 
study are not offered. The graph presented 
by the author, on the other hand, suggests 
that the phenobarbital and placebo groups 
were about the same (in terms of Wittenborn 
scores) at the end of the follow-up period as 
at the beginning of the study. The latter, of 
course, would imply that a general or over- 
all decrease in symptomatology at the end of 
that period could be accounted for by im- 
provements among chlorpromazine and pro- 
methazine group patients. 

2. Similarly, data are not provided which 
presumably provided the basis for the con- 
clusion that there was “a significant increase 
in symptoms” among the groups from the end 
of the treatment period to the end of the 
follow-up period. On the contrary, the graph 
provided suggests only minimal regression to 
initial level among patients in the chlorproma- 
zine group. It is conceivable, therefore, that 
the therapeutic improvement in the latter 
group was maintained during the follow-up 
period. 

3. In view of the (significant?) differences 
on the Wittenborn scale among the groups at 
the beginning of the study, the use of the 
analysis of covariance at the end of the treat- 
ment period and at the end of the follow-up 
period would have been preferable to the use 
of the analysis of variance, 

4. The investigators failed to pursue the 
data sufficiently by neglecting the application 
of appropriate small sample statistics (¢ tests 
between related means) to the data. Such 
tests might well have revealed that, while all 
drug groups improved during the treatment 
period, placebo group Patients remained es- 
sentially unimproved and, further, that all 
groups except chlorpromazine returned to 
their previous Symptomatic levels after a two- 
month no-medication period. 

Finally, a gross error in the interpretation 


Lloyd K. Sines 


of the data presented appears to have a 
made, i.e., differential effects among the ex- 
perimental groups were demonstrated at the 
end of the treatment period (F = 21.26, P < 
OL), and may well have persisted through the 
follow-up phase (an analysis of variance was 
not carried out on the latter data), indicating 
that in addition to whatever general improve- 
ments Were common to the groups, there a 
further differential change due to the ei 
treatments. The author's conclusion that a 
groups showed improvement of similar io 
grees” is, therefore, in direct contradiction 
the data offered. p 

While this writer agrees with Levin‘s stal 
ment that “in designing drug research, greai 
care must be taken to control incidental vani 
ables [and] caution must be used in inte h 
preting uncontrolled clinical studies in wie 
treatment methods are evaluated,” I fail ti- 
see how the data presented by Levin con 7 é& 
tute an empirical corroboration of such clich 
like admonitions, ia ete 

I find such methodological bungling in a 
chopharmacological studies at this late ea 
exasperating and, further, such tactical oe 
interpretive errors inexcusable in articles PU 
lished in the psychological literature. 


Received May 1, 1959, 
Early Publication, 
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A REPLY TO SINES’ NOTE ON A COMPARISON OF THE 
EFFECTS OF PHENOBARBITAL, PROMETHAZINE, 
CHLORPROMAZINE, AND PLACEBO UPON 
MENTAL HOSPITAL PATIENTS 


MONROE L. LEVIN 


Oneida Consolidated Schools, Oneida, New York 


Sines’ recent note (Sines, 1959) ey 
Aspects of the methodology and statistical 
Methods used in the writer’s recently pub- 
lisheq research (Levin, 1959). In SaN ae 
€ original paper in the light of Sines ee 
isms and Sines’ comments, attention shou! j 

© paid to the initial paragraphs of the A 

€ major purpose of the study was to es “a 
Mine whether, as had been anticipated in a 


Vance, variables other than drugs Eee 
Suffici P duce measura 
ent strength to pro ae enal 


°bservable changes in the behavior 2 

r 1 
Ospital patients, and whether the rua tee 
Changes would be in the directions a 
Dated. 


Methodology 


Sines objected to use of arbitr 
orm Pe in each of the subject gror pE 
. © grounds that there are wide fluctua aie 
Individual responses to chemical Gone 1 

€ further reports that others ee a 
Wide range of patient responses to 24 drug 
Tugs, concluding that individ x ER 
poe is to be preferred to uniior 8 
Of therapeutic agents. z in 

The Sady E question was cone a 
955, at a time when ataractic ore wats 

process of becoming available in Acai 

Ospital at which the study was oe often 
At that time, uniform dosages phe of 
Used, both because of the relative nes esis 
the ataractic drugs in state mental ho. Pate 
and because of the large numbers of pa ae 
for whom individual physicians Were resp! 
sible. ; 

Sines’ criticism did not take ir 
the fact that if the ataractic used i 


ary and uni- 


nto account 
n the study 


does, as was then being reported, produce 
dramatic and highly positive results in an al- 
most consistent way, use of the agent in even 
the limited fashion reported should have pro- 
duced positive and differential results similar 
to ones reported earlier by others. It was rec- 
ognized that uniform dosage might attenuate 
the results, but it was not believed that this 
would be sufficient to completely attenuate 
the effects of the drugs which were used. 

Use of physician-directed, modifiable dos- 
ages of drugs and placebo was considered but 
necessarily rejected as a possibility because 
of the innumerable problems it would have 
presented both in the administrative struc- 
ture of the hospital and in the design of the 
study. , ie d 

The dosages of ataractic and antihistamine 
were suggested by the pharmaceutical con- 
cerns involved as ones which were then con- 
sidered to be optimal under the conditions of 
the research. 

Sines states that bias of raters may have 
been a major factor in slanting the findings, 
because of the ability of ward personnel to 
identify the various drugs and placebo used. 
Attention is called to the methods used to 
minimize bias. If any of the ward personnel 
were biased because of their ability to dis- 
tinguish between the various tablets, the 
identical (not “similar” as Sines states) ap- 
pearance of the placebo and chlorpromazine 
might well have exaggerated, rather than 
minimized differences between the groups, 
and might well have favored a greater differ- 
ence than was obtained between the ataractic, 
placebo, and other drugs. 

Since patients were distributed in almost 
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random fashion throughout the hospital, it 
was assumed that any bias which arose would 
be inconsistent and sufficiently attenuated to 
become negligible. 

Sines’ third criticism is of the attrition 
rate (23%) reported. He indicated that the 
rate of attrition may have been a reflection 
of sampling bias. Every patient in a 2,000 
bed hospital who met the selection criteria 
was initially included in the study. Reference 
is made to the original paper in which it was 
indicated that most subjects were lost for 
administrative reasons, “Administrative rea- 
sons” included such factors as failure of 
ward personnel to administer drugs, failure 
to rate patient behavior at appropriate in- 


tervals, and failure to administer appropriate 


drugs. The vast majority of subjects were 
lost because of admi 


nistrative reasons, as was 
originally reported. The attrition rate, there- 


fore, was clearly not due to sampling factors 
but, rather, to factors which have no demon- 
strable relation to patient beha 
ing in the study. 

Since the hospital at which the study 
conducted serves an area representing 
quarter of the geographic area of the state in 
which it is located, and since almost all eli- 
gible patients participated, it is doubtful that 
the sample represented anything other t 
that which it was intended to. 


vior or group- 


was 
one 


han 


L. Levin 


Statistical Method 


In view of the purpose of the study, E 
data were examined to determine if mei 
were differential shifts over time in symp 
toms, as measured by means of the Wile 
born scales. Differential shifts should produc 
significant interaction between treatment E 
time. The analysis of variance (see Table E 
Levin, 1959) clearly showed that there W 
no significant interaction. a 

Sines appears to have confused the io: 
ing of the analysis of variance reported. in- 
significant F reported in Table 1 does ae 
dicate, as he says, that there were amr’. 
effects among the experimental groups Bt ae 
end of treatment period; the F merely n 
cates that significant shifts occurred in ihe 
symptom scores of all groups during 
course of the study. 
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ABSENCE OF ACQUIESCENCE RESPONSE SET IN 
THE TAYLOR MANIFEST ANXIETY SCALE* 


LOREN J. CHAPMAN 


University of Chicago 


axp DONALD T. CAMPBELL 


Northwestern University 


When attitude and personality scales of the 
agree-disagree or true-false format contain un- 
equal numbers of items worded in the direc- 
tion of the two ends of the personality dimen- 
sion, the response to the content of the items 
may be confounded with general tendencies to 
agree or disagree (Cronbach, 1946). A num- 

er of recent studies have investigated such 
acquiescence response set in the F scale from 
he Authoritarian Personality study (Adorno, 
‘renkel-Brunswik, Levinson, & Sanford, 1950) 
3Y means of correlating scales oF reversed 
items with scales of original items. A recent 
review (Chapman & Bock, 1958) has shorn 
hat all of these studies found evidence © 
Substantial acquiescence variance. 

Another scale which mig 
acquiescence bias is the Tay : 
ety Scale (Taylor, 1953), in which ith 

k items are worded so tuar a 
€ item contributes toward # 
A se seer a AS was constructed by ape 

literal reversals of meaning, €-8» tor 

often sick to my stomach,” h. 
T am seldom sick to my yl en in the 

If there were acquiescen nfluence the 

es it would be epeh to i 

Orrelati he MAS wi 3 zi- 
Ty are correlated with acquies 
cent tendencies. T c a 
fects, each S was also Pamo et al., 1950). 
sed F and E sca the test were prepared, 

Two versions © from each scale 


items 

each having half of oe other Pal negative, 
in positive form a” : 

ahs g supported in part by the Social 

1 This study W* 7 mittee of the University of 

Ghee Resear the Graduate School, North- 

icago and in ! 

Western University- 


part by 


with each item appearing in its positive form 
in one scale and its negative form in the 
other. Each S received the two forms one 
week apart. Since the E scale measures atti- 
tudes toward minority groups, Jewish, Negro, 
and Oriental Ss were not included. The final 
experimental group was 184 college students. 

As an additional intelligence measure for 
86 of the 184 Ss, OSPE percentile ranks were 
obtained from the university admission’s rec- 
ords, and for another 70 a sum of verbal plus 
mathematical scores on the college boards was 


employed. 
Results 


The Kuder-Richardson reliabilities of the 
positive and negative forms of the MAS were 
'87 and .85, respectively, and the correlation 
between positive and negative halves was .84. 
The correlation is seen to be almost as high 
as the reliabilities of the scales, a finding 
which is in striking contrast to the results of 
similar studies on the F scale, including that 
of Christie, Havel, and Seidenberg (1958). 
We conclude that the items of the MAS, un- 
like those of the F scale, are subject to little 
or no acquiescence bias. This is probably at- 
tributable to the quite specific and personal 
reference of the items. 

Table 1 shows the intercorrelations of the 
two MA scales with the other measures. Note 
that both the positive and negative forms of 
MAS show correlations with the original F 
scale (Fpos), significant beyond the .01 level 
of .19. No significant correlation with intelli- 
gence or with the E scale is found. 

Note that neither MApos nor MAney repre- 
sents the original MAS. When the MAS is re- 
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Table 1 
Relationships of the MA Scales to Other Measures* 


V.+M. 

Col. 

Dye Vig: Bie Bax OSPE: Bras 

MA por 32 07 11i 04 .00 —.10 
MA neo Zi .06 .05 08 — 01 —.09 


* Underlined values are significant at the .01 level, 


constituted from the item pool of the present 
study, it has a reliability of .84. The correla- 
tion between MAS and Fos is .29, 
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VALIDATION OF DOPPELT’S 


WAIS SHORT FORM 


WITH A CLINICAL POPULATION 


HUGH CLAYTON anD DAN 


PAYNE 


Colorado State Hospital 


I A 
ings, ae Jerome Dopplet published his find- 
Peep Ye: lora brief Torma of the WAIS. The 
tests; Ne consisted of the following four sub- 
icture p ment Vocabulary, Block Design, and 
Scores j rrangement. The sum of the four scaled 
constant multiplied by 2.5 and increased by a 
Constant which varies with the subject’s age. The 
o ee! for their respective age ranges, are as 
a fet: 0, Sate & 45-54: 8, 55-64: 
to th 4: 5, 75+: 4. The final sum is equivalent 
e Full Scale “Scaled Score.” The IQ is then 


found ; 
Und in the IQ table appropriate to the sub- 


Ject’s age 
t ae the above formula, Doppe! 
“ne Scale Scores for Wechsler's standardi- 
and ee Palate, broke them up into age groups, 
Brief en ran Pearson correlations between the 
thet Scale IQ and the Full Scale TQ for each of 
96, age groups. Pearson 7’s range from .95 to 
Wechsler’s standardization population consisted 
atona subjects, The question rais 
would Abeer with a clinical popu er 
Might e a real possibility that the correlations 
Of ne not run nearly so high with a population 

Mentally disturbed patients whose intellectual 
ieee is erratic in varying legrees. Another 
hat ion to be answered concerns the possibility 
Cert; the Brief Scale 1Q might be more valid wit 

ain clinical groups than with others. 

Il active test files in the psychology d 


this study may be ob- 
n, Psychol- 


pelt computed 


of 


lepart- 


1 
bie extended report of 
ogy without charge from Hugh Clayto Po 
Col Department, Colorado State Hospital, Pueblo, 
See or for a fee from the American Docu- 
mit tation Institute. Order Document No. 5922, re- 
ting $1.25 for microfilm or $1.25 for photocopies. 


ment of the hospital were pulled and examined. 
Those whose scores were based on all 11 subtests 
of the WAIS were accepted as subjects. The files 
were then classified by the following diagnostic 
categories (based on hospital staff decisions): 1. 
Schizophrenia (N = 72); 2. Personality disorders 
(N=51); 3. Organics (N = 27); 4. Mental de- 
fectives (V=28); 5. Mixed diagnoses (N = 
50). Pearson correlations were then run between 
the estimated IQs and the Full Scale IQs, sepa- 
rately for each of the first four categories, and 
then together (including category apa 

The ¢ tests failed to reveal any significant dif- 
ferences between the means of estimated IQs and 
the means of Full Scale IQs. 

The obtained correlations for the first four 
groups and for the total are as follows: .97 for 
schizophrenics; .96 for personality disorders; .96 
for organics; .92 for mental defectives; and ‘97 
for the total. Standard errors of estimate ranged 
between 3.4 and 4.6. A ż test for the significance 
of the difference between the r of .92 for mental 
defectives and that of the other three groups 
proved significant at the .02 level. With the aes 
sible exception of mental defectives, then the 
brief form of Doppelt appears as valid an esti 
mate of the Full Scale Score with a clinical po’ 7 
lation as it was with the “normal” standa diz: fen 
population. rdiation 
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THE VALIDITY OF A SELF REPORT MEASURE OF ANXIETY 
AS A FUNCTION OF THE TIME INTERVAL COVERED 
BY THE INSTRUCTIONS! 


BARCLAY MARTIN 


University of Wisconsin 


The instructions accompanying most Paper- 
and-pencil scales of Personality are vague with 
respect to the time interval for which the person 
is rating himself, although the usual implication 
is that the person is answering the items in terms 
of how he has generally been during his life. For 
many traits, and especially for a trait such as 
anxiety, there is little doubt but that most peo- 
ple vary considerably from day to day or month 
to month in the extent to which they possess the 
trait. It is not surprising therefore to find that a 
scale such as the Taylor Manifest Anxiety Scale, 
taken in terms of how anxious one generally is, 
frequently fails to predict anxiety as assessed by 
other methods in Particular situations. The pur- 
pose of the present research Was to experimen- 
tally explore the effect of different instructional 
time periods on the relationship of a self-report 
measure of anxiety to a criterion assessment of 
anxiety in a specific stress situation, 


Anxiety was Psychometrically measured by the 
Feeling Inventor 


n in an individual stress situa- 
Were confronted in close prox- 
1An extended report of this study may be ob- 
tained without charge from Barclay Martin, Psy- 
chology Department, University of Wisconsin, Madi- 
son, Wis., or for a fee from 


J: f the American Docu- 
mentation Institute, Order Doc 


ent . ‘ument No. 6017, re- 
mitting $1.25 for microfilm or $1.25 for Photocopies, 


tion in which they 


ously 
imity by two experimenters who rather pone : 
made continuous ratings on the Ss througho were 
15-minute session. Ss were told that my allow 
going to be asked to do things that woul were 
the experimenters to understand what oe an 
really like as persons, what their inner ee to Te 
fantasies were, etc. Ss were then aske d, an 
spond to one Rorschach card, one TAT a ex- 
to free associate for a short period. The novè: 
perimenters independently tallied nervous global 
ments throughout the session and made & at the 
rating of anxiety on a seven-point scale irdings 
end of the session. Continuous GSR reco 
were also obtained, domly 
At the end of the session, Ss were ranstt ce 
assigned to one of three groups and given ae o 
tions to take the Feeling Inventory in ie have 
(a) how they generally feel, (b) how ey just 
felt during the last month, and (c) how t 
felt in the 15- grouP 
In- 


terion anxiety measures in the expected dir r 
The highest correlation for this group a month 
base level skin conductance. For the r negative 
instruction group, there were unexpecte nervous 
correlations between rated anxiety and 
Movements, and the Feeling Inventory- ail 
Manifest Anxiety scores obtained in mals a 
group session did not correlate significan 

any of the criterion measures. 


ith 
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MANIFEST ANXIETY AND PERFORMA 


NCE ON PROBLEM 


SOLVING TASKS* 


DURGANAND SINHA? 


Indian Institute o. 


f Technology, Kharagpur, India 


anp TRIPAT RAJ SINGH * 
Patna University 


hie study, the performance of 20 high scor- 
Scale 20 low scoring subjects on the Taylor 
Set of of Manifest Anxiety was compared on a 
Six problem solving tasks which were novel 

of moderate difficulty. Three of the tasks 
esi Sensorimotor in character (Substitution Test, 
rol a Sorting Test, and Katona Matchstick 
Mah and the other three involved largely 
tides activities (Line-Pursuit Test, Mixed Sen- 
iine and Number Series). Within the general 
Dect area of Hull's behavior theory, it was ex- 
ee that tasks being complex involving 2 
tiv, rchy of competing responses, the higher 
a; bs level, as measured by high scores on the 
end scale, would lead to impairment of per- 

ance, 

ergh HA Ss had committed a few more 
Bro rs on each task, the performance of the fo 
ns did not differ significantly in respect 0 
m ors, However, on all the Katona problems 
ore LA than HA Ss had solved them, x” bad 


si 
Prob- 


Were 


p ficant in all instances (Problem 1: x= 
lem oti Problem 2: y= 5.23, P=; 
Bee X = 3.95, p= 05). sarmo 
im ut the HA group consistently required se 
tal € for solving both the sensorimotor an men 
tasks, ¢ ratios being significant In all cases 
ri one (Sorting: ¢= 4.0, p = 01; Substitution: 
= 3.4, p = 01; Katona: t= 3.4, p= 01; Line- 
study may be ob- 
nd Sinha, In- 


1 
tai An extended report of this 
‘ined without charge from Durganal 


ay Institute of Technology, Kharagpur, India, 
T a fee from the American Documentation hye 


ae Order Document No. 6018, remitting $ 
srofilm or $1.25 for photocopies. vi Re 
seg Formerly at the Institute of Psychological Re- 
Stu a & Service, Patna University, India, where 
na was conducted. nike 
Ve, A graduate student in Psychology at Patna 
Tsity during the sessions 1955-57. 


Pursuit: t= 3.2, p = .01; Mixed Sentences: t= 
3.88, p = .01; and Number Series: t = 1.59, p= 
not significant). 

The inferiority of HA Ss can be explained in 
terms of difficulty of integration of responses and 
the selection of the correct one out of many pos- 
sible responses. Increased drive level multiplied 
indiscriminately the strength of all competing re- 
sponses. Irrelevant and wrong movements were 
made and had to be corrected, This interference 
showed itself in slightly higher error score and 
significantly longer time required for the solution. 
Performance was of less integrative character due 
to “anxiety-produced interference” (Malmo & 
Amsel, 1948) or general “disorganization of be- 
havior” (Davis, 1948). The effect on error score 
was masked off, because Ss were allowed to cor- 
rect themselves during performance, and only 
those errors that persisted till the end were re- 
corded. However, error-corrections required time, 
and consequently the time scores in high anxiety 
Ss were raised. 

Relatively longer time required by HA Ss in 
solving problems has obvious implication on re- 
sults obtained on tests where speed of perform- 
ance is a significant consideration. Anxiety level 
seems to become a significant variable in test per- 
formance. It is particularly so on speed tests. 
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PSYCHOLOGICAL 


TEST 


Caligor, Leopold. The Eight Card Redrawing Test 
(8CRT). Kit containing test instructions, blanks, 
score sheets, and scoring masks, Pp. 148. 8CRT, 
P.O. Box No. 31, Gracie Station, New York 28, 
New York. Manual: A New Approach to Figure 
Drawing. Springfield, Ill.: Charles C Thomas, 
1957. 

This technique represents a mo 
ration to the Draw- 
requested to 
When the dr. 


onionskin. His exact 
“You may do anything 
of a person. You may add to it. 
ange it or leave it alone, Only again, make a pic- 
When the second drawing 
wing is then concealed and 
d over the second drawing. 
ested from the subject and 
tructions as he did for the 


ate primarily to 
the drawings. Some of the 
& categories are of the following 


structural aspects of 
principal scorin 
order: 


Degree to which com 

Height of figure 

Placement of figure on 
left) 

Stance of figure 

Ratio of head size to bod 

Sex of figure 

‘Transparencies 

Erasures 


plete figure drawn 


Page (top, bottom, right, 


ly size (height & width) 


REWIE Ws 


e fig- 

Relation of body walls and body arcas of i 

ure to the preceeding figure 
Degree of movement of figure A amount 
Manner in which the body is filled in (e-8» 

of detail and shading) 
Line quality (tremble, pressure, thickness) 
Symmetry of placement of body parts 
Clothing 
Omission of body parts degre? 

Each category is interpreted in terms of me a 


to which it shifts and varies over the E 
eight drawings. Caligor offers brief formulat nings 
cerning what he considers to be the merine 
the various categories, Illustratively, in re nts other 
“placement on the page” he says, “RICE Wade 
than center reveal limitation in the ability jndicate 
quately cope with the environment. pee tion ant 
inadequate cognizance or handling of stimu a 
attempted avoidance of the full impact ce signifi- 
ronment.” Further, in his description of t erase 
cance of “erasures” he states, “Most people ures 088 
two or more drawings. The absence of ar faculties 
reflects limitation of corrective and critica uent 
possible lowered reality testing and ea ire 
labile reaction to stimulation. Excessive ra er- 
flect hypercriticality, blocking or conflic orde! 
controlled resistance to stimulation. ma apple 
clarify how his scoring categories may aro 
he presents detailed analyses in his man analyses 
drawings of three different subjects. These i < 
are of a broadly impressionistic charac in 
parently involve the intuitive discovery © 
ingful pattern in a large array of seo were UP” 
Caligor does refer to three studies whic r escrip 
dertaken for validation purposes, but his nd it ® 
tions of these studies are extremely brier tly the 
clear that he did not attempt to test direc riod? 
validity of the meanings assigned to the ulations 
scoring categories. One can see that his fe ee a 
regarding the significance of given vere ces ab 
based almost entirely on his clinical cmp OR i 
that one must accept them on faith. The 8 


ee! 
presently a collection of hunches that have P of 
formalized by Caligor into a scoring system. SO cove 
his hunches are novel and interesting and may P’ 


con- 


eani 
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ieee 3 have an enriching effect upon figure 
with the z lysis. Thus one is particularly impressed 
emphasis ovelty and potential importance of his 
eg, u on such factors as spatial directionality 
and a vs. down and right vs. left), symmetry, 
ing to ee of maintaining continuity from one draw- 
Ove; i other; 
hen though, it must be said that his scoring 
cept or Bae not bound together by a unifying con- 
Consist Rees They seem, on the contrary, to 
ed in a heterogenous “signs” which were assem- 
the valų n arbitrary fashion. One must also question 
Scoring eof Caligor’s mode of defining many of the 
Vague meas His definitions are often very 
signs as į hazy, Illustratively, he refers to, various 
rity,” e indicating “anxiety,” “conflict,” “immatu- 
imeat sr ed ability to orient oneself in the envi- 
ness of obj ability to use inner resources,” “aware- 
ow paues or other persons in the environment. 
Subject ea more would one know about a given 
Ormati or having acquired such vague bits of in- 
Sent aes about him? The SCRT does indeed pre- 
but it me new ideas about figure drawing analysis, 
lacks the rationale or validation to be consid- 
a formal test—Seymour Fisher. 


B 
ee George K., Seashore, Harold G. & Wesman, 
eee G. Differential Aptitude Tests. Manual 
losa CÈ), pp. 94. New York: Psychological Corp- 
an New manual follows very closely the format 
chol e previous (1952) edition (see Js consult. By 
age 1953, 17, 78). The main change 1S that a 16- 
lem research supplement has been added. This sup- 
in ent offers data designed to validate the com- 
ne of the Verbal Reasoning and Numerical 
taty scores into an index of scholastic aptitude 
Speci in addition, six other studies selected for aa 
a ial interest to users of the tests. The bibliography 
S increased from 27 to 105 items. a manual re- 


a 
ins a model of its category.—2- $ 


Manual, 16 pp., answer shee! 
a Angeles: California Test Bureau, 
ud his 150-item inventory yields four 
es toward School, Mechanics of Stu 
item: System, Verification. The last one pe 
Si S with “the thirty most popular response: 
PPosed to validate the other scales. A good de: 
ork seems to have gone into the development bi 
the. instrument; its reliability seems adequate: A 
in re is encouraging evidence of its validity aak: 
Lite cational diagnosis with high school stu ae 
y e evidence is offered to support the supp 
nction of the Verification score —E. S. B. 


scores, Atti- 
dy, Planning 
d on 


Preference 


Edwards, Alen L: Edwards Personal E New 


Schedule. Manual, Revised 1959, PP- 
York: Psychological Corp., 1959. 
p This revision of the 1954 manual (see K 
SYchol, 1956, 20, 321-324) differs in only 


consult. 
minor 
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respects from the original. The directions for ad- 
ministration now include a section on machine scor- 
ing; a general adult sample now provides an addi- 
tional norm group; the bibliography has been ex- 
panded from 9 to 82 references, most of the new 
references representing studies in which the EPPS 
figured. The general adult sample is less than ade- 
quate for normative purposes because it consists of 
a nationwide sample of male and female household 
heads who are members of a consumer purchase 
panel] used for market surveys. It is not clear what 
this means with regard to its possible biases with 
respect to age, education, and class status. The mean 
scores of this sample vary from those in the other 
norm group, college students. But there is no effort 
to analyze the significance of these differences for 
the validity of the test. In fact, it is astonishing that 
no effort was made to summarize the relevance of 
the large body of studies in the bibliography to the 
test’s validity and reliability. The reviews of the 
first manual pointed to its deficiencies with regard 
to validating evidence. One wonders why the author 
and publisher bothered to offer a revision which re- 
vises so little and is so unresponsive to criticsm.— 
E.S B: 


Mitchell, C. California Analogies and Reasoning Test. 
High School and College. Forms A and B. Test 
booklet, with manual, 16 pp., answer sheets, scor- 
ing stencils. Los Angeles: California Test Bureau, 
1958. À 
A scholastic aptitude test in which content drawn 

from natural science, mathematics, social science, 

English, and literature has been cast into analogy 

form. The manual offers the necessary information 

on reliability norms, directions for administration and 
scoring, etc. The studies offered to support its pre- 
dictive validity are less than adequate because they 
are based on samples tested either concurrently with 
the collection of criterion data (academic grades) or 
where the grades had already been earned. Thus, 
there is evidence to support the test’s value for con- 
current validity or for postdiction, but none for pre- 
diction—E. S. B. 


Stone, Joics B. S-O Rorschach Test. College and 
adult. Test booklet, with manual, pp. 58, answer 
sheet, scoring stencils. Los Angeles: California Test 
Bureau, 1958. 


The S-O (Structured-Objective) Rorschach Test 
as its title suggests, attempts to tap the same ps; z 
chological processes as its namesake via iodinea 
technique designed for group or self administration 
to yield a uniform number of responses and an ob- 
jective method of scoring. For each blot, 30 percepts 
are selected and grouped into 10 triads = as to oo, 
yi a A basis for scoring on location, determinants, 
imited content factors (human and animal) and 
frequency (modal and rare). The 10 original amai 
are presented in one of three ways: projected on 5 
AA individual inkblot card sets, or via an illus. 
rated booklet. The subject is asked to choose ite 
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one item in each triad that is most clearly repre- 
sented by the blot or by some part of the blot. 
Choice of an item in a triad contributes to each of 
the four general categories of scoring much as in the 
standard situation. 

Standard scores are provided for 15 variables based 
upon a normative sample which tries to make up in 
numbers what it lacks in definitiveness. The norma- 
tive sample is an amalgam of 967 Brigham Young 
University students and 7094 selected occupational 
groups. The reported test-retest reliabilities (one- 
week interval) are acceptable but not great, rang- 
ing between .62 and .90. The 15 factors are either 
taken singly or combined in various ways to derive 
26 different attributes. 

The validity of the test seems to rest mainly on 
two bases: first, its supposed relationship to Ror- 
schach phenomena; second, two empirical studies. 
Without considerable empirical evidence, there is 
great room for doubt that responses to the SORT 
are mainly tapping perceptual phenomena analogous 
to its prototype. The method of test administration 
contains no procedures that ensure that the subject 
has seen the percept that he chooses nor for that 
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matter that he has even looked at the blot. Response 
sets of various sorts, particularly social desirability 
stereotypes, are probably greatly enhanced under 
such circumstances. The manual gives a brief ee 
of two unpublished validity studies. In one, er 
SORT increased the correlation of high school ei 
point average with first year grades from .59 io aa 
using the best 2 of 15 scores. No cross-validativt 
data are offered. In the other, the SORT variaba 
are correlated with supervisors’ ratings in 29 E 
pational groups. A suggestive but not impresive Ei 
of correlations was obtained. Again no cross-vali 
tion. an 
This all sums up to the fact that we have ae 
interesting new experiment in adapting Rors¢ ting 
testing techniques to the need for large scale Mt i 
Bu sad 
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Brief Reports 


The Journal of Consulting Psychology will 
accept Brief Reports of research studies in 
clinical psychology for early publication with- 
out expense to the author. The procedure is 
intended to permit the publication of soundly 
designed studies of specialized interest or lim- 
ited importance which cannot now be ac- 
cepted because of lack of space. Several pages 
in each issue will be devoted to Brief Reports, 
published in the order of their receipt with- 
out respect to the dates of receipt of the regu- 
lar articles. Most Brief Reports appear in the 
first or second issue to go to press following 
their final acceptance. 


An author who wishes to submit a Brief 
Report: 

1. Sends the Brief Report, limited to one printed 
page and prepared according to the specifications 
given below. 


2. Also sends to the E 


ditor a full report of the re- 
search study, 


in sufficient detail to give a clear ac- 
count of its background, procedure, results, and con- 
clusions, which will be filed with the American 
Documentation Institute to insure indefinite avail- 
ability, 

3. Prepares at least 100 mimi 
the full report, which the auth 
charge to all who request it a: 
lasts, 

4. Agrees not to sı 
journal of general 


eographed copies of 
or will send without 
s long as the supply 


ubmit the full r 


eport to another 
circulation, 


Specifications 

Brief Report. The Brief 

a clear, condensed summa 

full a 
sults as space permits. 

To insure that the 

longer than one prin 


n account of the re- 


Brief Report will be no 
ted page, its typescript, 


‘ the 
including all matter except the tine ae av- 
author’s lines, must not exceed 85. i 
eraging 42 characters and spaces in Jines 0 
Set the typewriter margins for short long Ï 
42 characters, which are 3.5 inches ca 
elite typing, and 4.2 inches long in pin nite 

The manuscript of the Brief Repe for its 
be double spaced throughout. Excep tyle of 
short lines, it follows the standard plication 
the 1957 revision of the APA Pu ces al 
Manual. Headings, tables, and rece in 
avoided or, if essential, must be “a be ac- 
the 85 lines. Each Brief Report Piute below 
companied by a footnote in the sty A not 
Which is typed on a separate sheet 
counted in the 85-line quota: 


be ob 

1 An extended report of this study ae Markt! 
tained without charge from John Doc, ` full 03° 
St., Prospect 6, Mass, (giving the author ee cu 
and address), or for a fee from the Ameri ar 


: A ent No. — oto- 
mentation Institute, Order Docum for ph 
mitting for microfilm or $—— 

copies, 


d r% 
Extended report. Because the extend? is 
Port is intended for photoduplica a : style 
not copy to be sent to a printer, of 
should differ in several ways from 4 report 
other manuscripts: (a) The extende ae ‘ot 
should be typed with single eee fg 
economy in duplication. (6) Tables i text 
ures should be placed adjacent to a pe 
which refers to them. A caption sho shoul 
typed below each figure. (c) Footnotes whic? 
be typed at the bottom of the page aspect! 
reference is made to them. In other a spec” 
the full report is prepared in the sty 
fied by the Publication Manual. 
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MENTAL HEALTH CONS 


ULTATION: THEORY AND 


PRACTICE 


ARTHUR J. BINDMAN * 


Massachuse 


of Ee 1952, the Division of Mental Hygiene 
ai, nsetts Department of Mental 
mental has been developing a program of 
ered t health consultation which is consid- 
Ponty be one of the primary services of its 
au Com mental health centers (Hallock & 
ment a 1956; Vaughan, 1955). In general, 
ew ; health consultation is carried out by @ 
man ourth member of the traditional three- 
Tole child guidance clinic team, whose basic 
ae to develop relationships with those key 
Ma: ons in the social system who are Pr 
tily concerned with families and childveh 
oN age focus of this work has been with 
ery ers, although mental health consultation 
i have been provided to juvenile courts, 
Ma ation officers, child welfare agencies, ani 
Ny others, 
eee role of the consultant is varied. He 3s 
ri vested in helping key persons on a crisis- 
ented basis in order to aid them in more 
wae utilization of their professional roles 
Se h regard to a particular child or client; 
edly, he acts as a technical assistant 1 
€lping a consultee or agency M a 
Mical appraisal or referral for those chil- 
oe who need specific diagnostic eval 
t follow-up (Caplan: 1954a, 1954b, 195 â, 
ees Hallock & Vaughan, 1956; yave 
55). The consultant is clinically trained 
and proficient, and he may be either a PSY 
hiatrist hiatri ia] worker, oF & clini- 
al , psychiatric sock ne ae 
_ Psychologist who has recel 


taining in mental health consultation. 
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Features of Mental Health Consultation 


A definition of mental health consultation 
can be distilled out of the writings of a num- 
ber of workers in this field (Caplan, 1956b; 
Prosser, 1957; Towle, 1950), as follows: 


Mental health consultation is an interaction proc- 
ess or interpersonal relationship that takes place be- 
tween two professional workers, the consultant and 


the consultee, jn which one worker, the consultant, 


attempts to assist the other worker, the consultee, 
solve a mental health problem of a client or clients, 
within the framework of the consultee’s usual profes- 
sional functioning. The process of consultation de- 
pends upon the communication of knowledge, skills, 
and attitudes through this relationship, and there- 
fore, is dependent upon the degree of emotional and 
intellectual involvement of the two workers, A sec- 
ondary goal of this process is one of education, so 
that the consultee can learn to handle similar cases 
jn the future in a more effective fashion, and thus 
enhance his professional skills. 


One can immediately see that similarities 
arise between consultation and the educa- 
tional process. Caplan (1959) points out that 
consultation makes use of so-called oppor- 
tunistic characteristics in the consultant-con- 
sultee relationship, while education generally 
emphasizes a more systematic approach, with 
predetermined curriculum and a planned 
learning exercise. Perhaps problem centered 
seminars and individual and group supervi- 
sion come closer to the consultation process 

Other differences are noted between con- 
Loess and ay processes of education, 

ychotherapy, and admini i 
ve Pre oe (Caplan, 
i 1 The consultee usually initiates consulta- 
tion in regard to a current mental health or 
work problem, while in education or supervi- 
sion the relationship is primarily initiated 
Pa above.” Thus, consultation is based 
tea ated eee the “authority of 
authority inherent on a Ta a a a 

t administrative relation- 
ships or as in the teacher-pupil relationship. 
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2. The consultant usually enters the con- 
sultee’s social system or field of forces on a 
temporary, short-run basis, and therefore the 
scope of his work is somewhat limited and 
usually concerned with a specific problem 
area. Educational methods may cover a wide 
range of problems and they may maintain 
teacher and pupil together for a fairly lengthy 
stay. In this way, consultation also differs 
from most types of psychotherapy in which 
patient and therapist usually develop a long- 
term relationship and the therapist is con- 
cerned with many aspects of problems within 
his patient. 

3. In many cases the consultant will be of 
a different professional background from the 
consultee and not just a more senior person 
in the same field. In supervision this is often 
not true, particularly in Casework. This may 
appear to be a minor distinction, but it serves 
to highlight the fact that case consultation 
attempts to utilize mental health principles 
whereby workers who do not consciously fee] 
that they are directly involved in the mental 
health field can be helped to become more 
sensitive and secure in solving problems which 
hinder good mental health practices. 


4. The consultant usually plays an 


advi- 
sory role, and doe 


s not have to implement a 
plan to solve the problem himself, The plan 
for the solution of the problem is left to the 
consultee. The latter may or may not wish 
to follow through, but regardless of his wish, 
he should not expect the consultant to carry 
out the steps of problem solution himself. He 
can, however, expect continued support and 
assistance from the consultant as the con- 
sultee tries to solve the Problem. In this way 


consultation differs to some extent from for- 
mal education, 


may actually ob 


5. Finally, the consultant is Usually not in 
a position of administrative Control over the 
consultee. The consultee js usually not held 
accountable for following through the results 
of consultation. All along the line, it must be 
clear that the consultee can “take it or leave 
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Re e 
it,” whether this applies to initiation e 
consultation or to the follow-up of ta 
tions. Baker and Siegel point out thai ae 
sultation is more effective if the ee 
uses his own competence to ana state 
for help and requests it. They fur ek con- 
that sometimes the consultee may pe for it 
sultation, not because he sees a ne 
but because of administrative ee: 0 
anxiety, or a feeling that this is m t asking 
do. In the long run, they suggest ; nae 0 
for help may actually connote ina a Siegel: 
the part of the consultee (Baker tion an 
1953). Thus an adequate consulta the de- 
outcome are solely dependent upon bet 
velopment of a positive relationship, 
consultant and consultee, with bot ith 
the option to withdraw. Mental ee 
Consultation can be subdivided ee 
categories: (a) case-insight, (b) act 1956% 
and (c) consultee crisis (Caplan: 
1959). 


Case Insight Consultation 


s of 

In this situation, the problem is ven g 
lack of insight by the consultee ino nent? 4 
lems that surround the client. The € this may 
havior may not be understood, and 6 ma 
result in an increasing appearance par k 
adapativeness to a situation on the increa™ 
the client. The consultee may Become ana 
ingly concerned with this behavior Jem. 
know how he can handle the probe itua” 
role of the consultant in this type ar 
tion is to increase the understanding or 
Consultee by pointing out the ber en „ Du 
psychological functioning of the ¢ the cor 
in a way which is appropriate to rhaps th 
sultee’s professional background. R jot 
best technique is the use of joint 0 can ob” 
since the consultant and consultee a natt 
serve and discuss their perceptions P ee 
ral, nonthreatening fashion, with the one th 
gaining new knowledge and insight 
client’s behavior, which he can ie 5 
hance the environment and reduce ; 
turbing behavior pattern of the client: 


a 


su 


ais 


Action-Help Consultation a the 

This type of consultation is used wher pif 
consultee lacks the skill or facilities tbe 
agency to assist a client, nor has a 
knowledge or method to call in outside 4% 


Ee. r_” ~~  @2rys 


pe 
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cies that could help for this purpose. The 


con, : i : 
. Consultant, in an active fashion, evaluates the 


on strengths of the agency and the 
ever, he p which might help the client. How- 
hint 2 rs with the consultee in a some- 
le. the irect and nondirective fashion to 
clarified feel that his views are 
out his pl nd supported, so that he can work 
Without ay in as able a fashion as possible 
Posed in ne consultant s plan being superim- 
meh = direct manner: Usually, through 
roaden od, the consultee’s horizons begin to 
able to a he becomes more flexible and 
out as aale more difficult problems with- 
uture rhe consultation assistance in the 
also give S time goes on the consultant can 
oncerniy pers information of a direct nature 
with re experiences of other consultees 
Consulte llar problems, which may enable the 
echni = tp broaden his armamentarnumn of 
tun a for assisting clients. In the long 
ecom 1S experience should help the consultee 
ferral oe more sensitive case-finding and He 
a bt ti who can use facilities to a better 
age, 


Co 
nsultee Crisis Consultation 


TE a number of cases, a disturbed or 
urbing situation in a client may trigger 
a crisis in a consultee (Caplan, 1956b; 
aughan, 1955), Quite often it is a type of 
re~ avior in the client which stimulates the 
ge gence of similar problems 1m the con- 
ee which he has learned to control or sup- 
ae On the other hand, a crisis in a an 
i tee may precede a crisis in a client, an 
ai turn trigger off disturbing behavior 1n the 
ent. In either case, the consultee begins to 
‘stort and stereotype his relationship with 


e client, and begins to project his own past 


dificul ies i i i ip. He ma feel 
t relationship. He 1 y 
ies into this re ranih rath 


at the client has a problem, w r 
the client serves as a displacement object for 
© Consultee’s disturbance. This pies ag 
reat reduction in the consultee s abi ity to 
function in a smooth, effective fashion in his 
Professional role. Therefore one of the pri- 
Mary aims of mental health consultee crisis 
Consultation is sugseste by Caplan (1956b, 


D. 77); namely; 

ak of the self in the pro- 
anus sag educators’ Use 4 pro 
etapa Ss so that their personality strengths 
May be more effectively mobilized for the mental 
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health of their pupils, and so that their unsolved 
emotional problems may not interfere with the uti- 
lization of their existing professional knowledge and 


skills. 


The role of the consultant in this type of 
situation is to develop first a supporting, posi- 
tive relationship with the consultee, in which 
the consultant begins to be an accessory ego 
figure to the latter. He does this by listening 
to the consultee’s problems and “playing for 
time” in order to foster the relationship with- 
out significantly reducing the anxiety of the 
crisis situation. Generally this relationship 
can be established fairly quickly, and then 
the consultant begins to reduce the crisis by 
several techniques. 

The first technique is that of “segmental 
tension reduction,” in which the consultant 
fosters discussion focussed around the client’s 
problem, which by implication is of concern 
to the consultee’s own problems. “The con- 
sultee’s segmented problem is not discussed 
explicitly and directly in regard to himself, 
but once removed in relation to the client” 
(Caplan, 1959). This “second-hand” or im- 
plied method of discussion helps to reduce 
tension within the consultee, which in turn 
reduces the tension within the client, due to 
the close psychological linkage between them. 

A second technique in crisis reduction is 
“dissipation of the stereotype” (Caplan: 
1954a, 1954b, 1956a, 1956b, 1959). This 
consists of the consultant focussing with the 
consultee upon certain realistic aspects of the 
client’s behavior which make him more mean- 
ingful as a human being for the consultee. 
The consultant often does this through joint 
observation of the client, or in discussion in 
which he describes his personal views of the 

ee a the consultee to do so. 
pir aor Ge $ — to bridge the 
aoantionis and Aia b based, stereotyped 
of the client and the pasate cee appraisal 
siti, fedücesprobie e situation which, in 
iek ms between consultee and 
Ser mica m is the fact that the client 
need of more ms erage disturbed and in 
ment. The co x tet eee MaE 
a ae age ae uses the consultation 
aneen the clien PS eny CUES as possible 

8 client’s behavior. He also may 
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review recorded data as well as observe the 
client in conjunction with the consultee so as 
to gain some diagnostic clues. If the consult- 
ant feels that the client is seriously disturbed, 
this does not necessarily infer that the con- 
sultee does not need crisis consultation. The 
consultant may still employ these methods to 
assist the consultee in his relationship with 
the client, but at the same time he may shift 
his role to one of action-help so as to assist 
the consultee in making a referral of the cli- 
ent to an agency. 

It should also be noted that the avoidance 
of psychotherapy is one of the cornerstones of 
the consultation method. There is an aware- 
ness of the personal implications of the con- 
sultee’s difficulties in his work, but the latter, 
and not his intrapsychic conflicts, are the 
focus of the consultation process (Caplan: 
1956a, 1959). If the consultant allows him- 
self to get involved in the consultee’s intra- 
psychic problems he is falling into the trap 
which has been set for him; namely, that the 
consultee was not fully certain that he is to 
play the role of a patient, but now he has 
proved that he is to do so. The consultant 
must do certain things which border upon 
psychotherapy at times, but are not neces- 
sarily the same. 

The consultant develops a relationship with 
the consultee which is also seen in psychother- 
apy, although on a much slower and more in- 
tensive basis in the latter case. In psychother- 
apy, the therapist asks for intrapsychic ma- 
terial to be provided by the patient, while in 
consultation the consultee is actually kept from 
giving such material about himself. The focus 
is upon the client and his problems, and only 
through implication do some of the consultee’s 
difficulties become involved (Caplan, 1955). 
In fact, the consultant bolsters the consultee’s 
defenses by support and reassurance of his 
adequacy, while in Psychotherapy the thera- 
pist may weaken or tear down neurotic de- 
fenses before rebuilding new ones. Another 
difference is the fact that the Consultant does 
not interpret in a direct fashion in relation to 
the consultee’s behavior, while in Case insight 

y give some interpretation 
of the client’s behavior which can assist the 
consultee in helping the client. This, too, 
differs quite radically from Psychotherapy. 
Finally, in most consultation relationships 
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there is an attempt to handle a segmental 
problem that faces a consultee, and once a 
solved, the consultant withdraws. In cer 7 
types of psychotherapy the therapist fi 
also handle specific problems, but genen ee 
therapy is concerned with a range of prob ie 
within the patient. It can be agreed, on a 
other hand, that corrective emotional on 
ences take place both in psychotherapy a 
case consultation, which may be the ™ 
important basis of comparison between if 
two methods. Nevertheless, one would bi a 
put to compare the depth and intensa 5 
this experience in therapy with the r that 
narrow, segmented emotional expen 
occurs through the consultation method. 


A Mental Health Consultation Case 


ajus- 
This case is a consultee crisis type- Be: 
trates various problems which are © o 
tered in the initiation and follow-UP wi 
mental health consultation relationship con 
a teacher. It also demonstrates how ‘aie je 
sultant “plays for time,” becomes an nsulte® 
tant accessory ego figure for the ae d 
(teacher), helps to reduce her tenna 
aids her in accepting a more realistic throug 
a client (child). This is accomplished xieties 
a reduction in the consultee’s own ern? 
by means of implied discussion a 
the client and his family, but bg 
indirectly to the consultee’s relations R s ow 
the client. The case also shows how gultee® 
sultant assists in changing the a of 2 
stereotype about the client from a child 
“bad, disturbing child,” to one O the c0 ig 
who can be greatly aided through once 
sultee’s understanding and support e cone 
these changes have been effected, hue jn ê 
sultee is able to react toward the clie tut” 
more positive fashion, and the child’s 
ing behavior is reduced. a 
The mental health consultant, @ ol Y 
Psychologist, had been visiting a apne oct! 
tem on a biweekly basis as part of t entio” 
mental health center’s program of prev orice 
at the elementary school level. He wi cted 
through the school social worker, who ught 
as a referral agent for teachers who pa p’ 
his help regarding “problem children- ped 
role appeared to have become well ace a 
by the school system, and he was provi“ ad 


substitute teacher who accompanied him 


jini 


po 
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took over the classes while a teacher was be- 
ing seen in consultation. 

The school social worker was most coopera- 
tive and eager to learn about mental health 
consultation and how he could relate his role 
to the consultant's. He readily complied with 
the consultant’s approach to mental health 
Problems and soon was making some of the 
best referrals from teachers in his school 
uildings, Although the mental health con- 
Sultant received his referrals through the 
School social worker rather than direct self- 
referrals from the teachers, this did not ap- 
Pear to produce a barrier in his relationship 
With the teachers. The school social worker 
ad clarified his role with the teachers to such 
aà degree that he was highly accepted and 
often used, and this in turn aided the con- 
Sultant in developing his own role. 


Initial Consultation Interview 


- Tn mid-October the mental health canse 
ant learned through the school social mon : 
at a teacher wanted to see him abou 


child in her third grade class. The school so- 


cial Bia 3 t that the child, 
Worker mentioned the faci Se ool 


eter, had ing poorly in h 
Work and Pon P be enhet impt 
€ also said that the teacher was guite oP. 
Set about the particular situation. Theta me 
aY the mental health consultant visite 
School and met with the teacher. hout 50 
he teacher was an individual of sribed as 
Years of age who can be best oe eaultant 
efficient and conscientious. phe si entered 
"ealized when she (the teacher) eae previ- 
consultation room that he had ha 


b- 
7 erved as a SU 
a contact with her. She ae of time dur- 


Stitute teacher for a short perl’ © accom- 
Mg the previous school sheer aU 
Panied him and taken over jon visits. 
days rie = had made consultation V 


Seen men- 
. ea ile riding in the 
uring those visits, while £ the teacher had 


tal health consultant’s | how she had been 
escribed in great detal a had never had 
Married for a long time Teed said that she 
any children of her OWP- Junteer or church 
Was interested ii doing Y house and garden, 
y ing U 
aR and Bee eee reasons that she had only 
“nd it was for for many years. She 


peen teaching pee "full-time this year be- 
ad decided to 


cause of the shortaZe of qualified teachers. 
o 


lasses on several 
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During the previous consultation visits when 
he had become acquainted with the teacher, 
the consultant was struck by the great sense 
of duty which this teacher felt she had “to 
help children to learn.” When she described 
her role as a teacher she would often say, 
“Every child can learn if we really work at 
it with him.” She also had strong feelings 
about the role that the home and church 
played in the life of the child. She decried 
the fact that modern parents often did not 
provide home life which was intellectually 
stimulating to the child. She mentioned how 
she would often take children who lived on 
her street into her home and talk with them 
about school or reading. The teacher seemed 
to be particularly upset about the fact that 
children would not learn and “wasted” their 
time. It seemed most difficult for her to ac- 
cept this since she herself was so efficient and 
careful in the way that she used her time. 
The first description of the child by the 
teacher was the fact that he did “nothing at 
all.” She went on to say that he “is emo- 
tionally disturbed, wastes his time, and has 
very few good work habits.” She said that 
Peter was 7 years, 10 months old and in the 
third grade. He had difficulty in previous 
grades, but psychological tests had shown 
that his intellectual ability was above aver- 
age and he should be able to accomplish ade- 
quately. 

At this point the teacher described how she 
had become so upset by Peter’s behavior that 
during the previous week she had called his 
father and asked that he come to her home 
for an interview. She admitted that the father 
had been angry at her request but that he 
had come. She described the father as very 
upset and disappointed with Peter’s poor 
school work, and said that he forced the child 
to do homework nightly. The school social 
worker had also spoken to the father during 
a PTA meeting and had recommended that 
the father be somewhat closer to his son by 
doing things together, but the father seemed 
to have interpreted his remarks as forcing the 
child to do more homework. It seemed to the 
teacher that the father was being too harsh, 
and she told him quite directly not to force 
the child. On the other hand, she also told 
the father that she was worried about the 
child’s poor school work and that she felt that 
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this was related to the child’s problems at 

home. The consultant was rather surprised 

that the teacher had taken matters into her 

own hands to such an extent. He asked the 

teacher how the father had reacted to her re- 

marks. She admitted that he had been very 

angry at her, but as the interview continued 

he seemed to quiet down and said he would 

look into this problem, 

The teacher went on to describe the home 
situation. She said that the mother was a 
very nervous person and the father was very 
hostile and negative. It was mentioned that 
Peter’s younger brother was ill and had to 
have a number of operations. The teacher 
turned to the consultant and said that she 
thought it was a poor home. She asked what 
the consultant could do for her in this situa- 
tion. The consultant felt that the teacher was 
looking for specific, concrete methods of han- 
dling the child and family, just as she might 
rigidly structure her teaching methods, He at- 
tempted to focus upon the child’s Problems 
and play for time. He asked about some of 
Peter’s behavior in the classroom. The teacher 


various Prizes, but this wa 
He was a somewhat hos 
child, which also seemed to upset the teacher. 

She turned to the consultant and again 
asked quite directly what he could suggest 


for her to do, The Consultant attempted to 
relate the child’s i 


this point of view and i 
long discussion of the child’ 

For the third time she asked į 
sultant could make any recommendati 
cerning ways in which he could be helped to 
learn. She said that another Parent-teachers? 
conference was coming up, and she wondered 


Bindman 


what she might say to the parents. The E 
sultant and teacher discussed the conien ip 
and the consultant suggested that oe fit 
teacher could talk to the parents ae 
important interrelationship between the dee 
and the school, perhaps they could p in 
stand why Peter was adjusting poorly 
school. 3 Ga 
The consultant hoped that this z r 
mark and suggestion might be accep a 
the teacher, since he felt that it was the n l 
tional climate in the school, as e 
largely by the teacher’s attitude an A: y im- 
tion toward Peter, which would be bi he 
portant in his future behavior. Howe to t 
could not make this a direct statemen te 
teacher at this time since it was rela 
her own segmental tensions. ) leaves 
At this point the teacher got up “Const - 
saying that she still wished that the “ations 
ant had given her more specific emt e 
but that she would talk to the —r 
hoped that the child would not ne som! 
Severe learning and behavior prablem m 0 
day because the school had not been happ: 
handle him. She seemed to be very a pains 
Although the consultant took aoe : 
to interpret his role to the eno 
start, nevertheless, he could see remarks 
Wished to bypass these introductory oint and 
and go immediately into the case in P when 
receive a ready-made solution. Thuta dis- 
the consultant suggested that he ge com 
cuss the problem with her instead jiscuss” 
pletely taking it over, or when he ae of 
matters of an emotional nature met y 
giving direct suggestions for helping her an% 
to learn, he did not fully aeuo, ustra d 
iety. He left her feeling somewhat nat ad 
and angry toward him. The consu pe sitt | 
Played for time to learn more about t tionshiP 
tion, and had tried to develop a rela ly at 
with the teacher. He had tried to Satis 
the client’s relationship with his oe time 
important in his adjustment, at the smeultee’ 
Suggesting by indirection that the are im 
relationship with the client was of wi ne 
portance. The consultant was somewh4 en 
certain that the initia] interview ha chet 
satisfactory, and he wondered if the ter ake 
would return when she did not wish to ” 


a definite appointment for his next visi 
the school. 


was 


`j 
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Later Consultation Contacts 


At the next visit to the school, two weeks 
later, the teacher had informed the school so- 
cial worker that she still did not wish to see 
the consultant, She said that she felt that she 
could handle the situation now without his 
aid. The school social worker mentioned this 
to the consultant and also remarked that the 
teacher seemed to be antagonistic toward any 

eP from the consultant. 

Wo weeks later the consultant came to the 
‘hool again, and was met in the corridor by 
the School social worker, who told the mental 

ealth consultant that the teacher wished to 
See him. He also said that the teacher was be- 
coming so anxious over the situation that so 
was talking around town about the child and 

'S family, This'was very disturbing to the 
Schoo] social worker and the school ape a 
She they wondered if the consultant coule 

andle this with her. After some discussion it 
Was agreed that this should be handled by t t 
Schoo] and not the consultant. The consultan 
Felt he must have the teacher's confidence 
and he could not enter into an administrative 
“lationship with her. ji 

e eate ltant also felt somewhat geen 
about this discussion with the sehnal q 
Worker, since he wondered whether he we 
S d her problems 
"ee to discuss the teacher an discus- 
With school personnel. He shifted era the 
sion to Peter’s problems rather tha 


r hi mily. 

teacher's reaction to him aan aE ; 
n i i ial work ddenly 

he he did this, the soc ming more ag- 


remarked that Peter was beco m ee oe 
ities sal ee E N Eha jin quite 
lifting little girls’ skirts. This hi P is 
disconcerting to the teacher, and Se e 
Crested in seeing the consultant abi ra 
child. Before departing, the sc OS te 
Worker said that he would Gea a 
teacher about keeping this case 
el er, she 
When the consultan cae ee cies 
immediately mentione 
Was one again when she had oa 
the PTA meeting. She said that a LU 
Was very disturbed, and while talking with 
her had cried continuously, telling the teacher 
how she did not get along well with her hus- 
band. She suddenly broke down and cried 
further, saying that the doctor had told her 
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she was going to die with this pregnancy. 
There was some vague discussion of a rela- 
tionship between pregnancy and cysts which 
might result in her death. The teacher ke 
extremely upset by this whole matter and di 

not know what to do for the mother. a 
consultant suggested that the mother mig t 
be over-reacting to her pregnancy, part 
larly if she were the nervous person that t e 
teacher described. This idea seemed to oe 
the teacher somewhat. The consultant aske 

about Peter and the family, focusing upon 
the child again. The teacher remarked that 
the parents had taken her advice about 
Peter’s needing help and had taken him to 
a private child guidance clinic for one visit. 
She did not know the results of this visit. 

At this point the teacher remarked about 
Peter’s aggressive behavior. When she asked 
the child why he was naughty, Peter had said 
that “bad voices” made him do those things, 
She seemed to be very fearful of this remark. 
The consultant interpreted this remark to the 
teacher, suggesting that perhaps the child 
was wrestling with strong and upsetting feel- 
ings and this was his way of expressing them 
more openly. The reason for this interpreta- 
tion was that the consultant felt the teacher 
was quite disturbed by the boy’s remark. The 
consultant was trying to alleviate some of 
her anxieties about her own impulses, which 
appeared to be closely related to her identifi- 
cation with Peter. The teacher said that she 
had told Peter to ask God for help, and she 
was very fearful of what his remark had 
meant in terms of a “mental disturbance.” 
She did not remark about Peter’s sexualized 
behavior. 

The teacher suddenly changed the subject 
and started describing the family again, tell- 
ing how they were rather strange people who 
did not get along well with others and were 
even rejected by their neighbors. After some 
discussion, the consultant suggested that this 
was useful background information in terms 
of the child’s basic school problem. The con- 
sultant, focussing on the child again, went on 
to remark that, actually, the fact that Peter 
was able to express these inner feelings to the 
teacher seemed to be a positive and important 
factor in helping him. He said that if Peter 
really did feel he could tell the teacher about 
these bad thoughts it was because he basically 


480 Arthur J. 
had a good relationship with her. The teacher 
seemed to react positively at this remark. 
She said that perhaps she had been wrong 
and had misunderstood and mishandled him 
at times. She seemed to be looking to the con- 
sultant for his approbation, The consultant 
suggested that all teachers feel conscientious 
in their work, and want to help children such 
as Peter. He went on to say that it was really 
not a poor reflection on teachers if things 
did not move smoothly, since this was really 
a difficult task. The teacher seemed to be 
more relieved of her personal anxiety and be- 


gan to remark how unhappy a child he really 
was. The consultant 


press her thoughts an 
neurotic difficulties. B 
expressed her own fee 
nes and disturbance, 
noted. This rose to a 
sultee discussed the client’s 


the consultant did not deal directly in a 
therapeutic fashi 


this b F 
and had tried to talk with him, and To 
stopped within a few days. She also men- 
tioned that he had been 


h writing love notes to 
a little girl. This, too, had been disturbing to 


Bindman 


her, and she had threatened Peter, s 
that she would punish him severely ii ap 
his parents if he continued to do this. hiie 
peared to the consultant that she aig Peters 
tempt to gain any understanding of ultant 
motives in such behavior. The cog these 
wondered why Peter might be doing ae 
things. The teacher did not wish to ds 
his motivation at this time, but Wri 0 
began to talk about the child’s mother 


= 
———— 


rom 
She showed a letter to the consultant ; 


his mother to her, The letter had some 
strange wording in it, upon which jscussi0 
sultant remarked. There was some di some 
of the mother as a very anxious an 
what peculiar individual. vain the 
The consultant felt that once “aontiied 
teacher was becoming too closely i mothe 
with the family and with the pregnan us back 
in particular. He tried to shift the E 
to the child by remarking that peria ot 
mother was a very disturbed person, jth the 
the same time the school was face "a 
Problem of Peter and his need for SUPP pe 
from that source, The teacher aces g mer 
stimulated by the word “support a reading 
tioned how he did much better in r¢4 
when he sat near her. The consultant F 
up this point and re-emphasized thera 
need for a close relationship. The teac O 
that perhaps she could try to bag p 
closely with him. As she said this, i 
sultant was not certain how clo and 
let herself get to this frightened chi a 
family, although he felt the teacher h an 
some headway in this regard. The "iscusi" 
consultation session was spent m aaa : 
how a disturbed child may sometimes anc f 
other sources of comfort and a $ 
he cannot receive this from his ramia 4 
Consultant again re-emphasized the fa ortan! 
the teacher seemed to be a very aP emed 
individual in the boy’s life, and she ing thie 
to be supported by this remark. Duri redut? 
interview, the consultant continued ara: s 
the teacher’s anxiety, and through his } peci? 
ing relationship he made some more SI atio” 
remarks about the teacher’s role in Fiscus 
to the child. The teacher began to AA 
upsetting sexual material, but her wis) p 


3 co! 
drop the subject was respected by the 
sultant. 


eas ate!’ 
The next visit was made a month Jat 


ke! 
icke! 


he | 
d E 
d to b 
men 
d 


ther ; 


d's | 
hi t 


Mental Health Consultation 


a teacher immediately remarked on how 
he prea Peter was since the consultant’s 
Te an He had stopped writing notes, and 
She oe to be settling down to his work. 
maki of an incident where children were 
ae placemats as Christmas gifts. Most 
<a them for their mothers, but in 
girl 4 case he remarked it was for the little 
his o whom he had been writing love notes. 
E discussed, and the consultant sug- 
ade that perhaps Peter needed love to such 
ie that he looked to other female fig- 
ae such as little girls, At the same time, 
A eo that mother’s pregnancy might 
ets 7 motivating him toward sexual inter- 
aus he teacher seemed ready to listen, and 
accepted these remarks, saying that she 
ad never really understood the reasons for 
= behavior until now. She also spoke about 
8 dress-lifting episodes for the first time, 
a said that maybe he was doing this be- 
Use of his mother’s pregnancy, t00. 
a She continued on with some more positive 
atements with regard to Peter. She re- 
marked how he had “guarded” a small Christ- 
™as tree in the school room when she had 
SUggested that he be the person to watch over 
th He seemed to like this role very much, and 
he teacher was pleased that he had done a 
Bood job. It seemed that the teacher wes 
Much less anxious and tense about the case 
at this. point. She discussed it from a much 


More ge i int, saying that now she 
general viewpoint, Say’ Ž and and how 


Understood the family backs 

nnhappy the child had been. She wanted to 
elp him and her goal was to at least stari 
where he was and see where she cou fat 
With him, The consultant pointed on! £ S 
hings seemed to be moving along coe se 
at this point. The teacher smiled happy Sat 
asked if she was doing & good job, aE 


ildren for a long 
She had not taught young a was not sure 


time before this past year $ 1 
if she cond really work well with ne ot 
this age. The consultant hala ae 
Could see she was stad to cre 

n 


4 relationship with 
sti smog eoii any om Ns 
learning. At this poin Ren the be ae 
Many positive remarks 4 ts ee parents, 
Saying that they seemed Ee as coopera- 
tive ON The g endel some gen- 


meeting 
eral discussion abo" mental health consulta- 
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tion, with the teacher saying that she felt 
much better about the whole situation. When 
she left, she said she did not know if she 
would have to see the consultant any more. 

This was the last time that the consultant 
saw the teacher in formal mental health con- 
sultation. However, on an informal basis, he 
would sometimes see her in the school lunch- 
room. She remarked through the remainder 
of the school year that the boy seemed to be 
adjusting much better and was keeping up 
with his school work. In the spring, Peter’s 
mother had a baby and was in good health. 
Tt was felt by the consultant that something 
had been accomplished in helping the teacher 
clarify her interpersonal relationship with this 
boy as well as her view of his family. In this 
final interview, the consultee appeared to be 
able to accept and deal with the client in a 
much more positive fashion, and she is more 
understanding of his needs. At the end, she 
indirectly stated that she had become more 
understanding and cooperative as she dis- 
cussed the client’s family. The stereotype was 
reduced through discussion, and all were ac- 


cepted more warmly. 


Evaluation of Consultation 


In four contacts, this very conscientious 
anxious teacher seemed to have been able to 
work through some of her own feelings with 
regard to a child and family who presented 
many problems of a disturbing nature to her. 
There were several features in this case which 
were of particular interest. The teacher was 
operating at a high level of anxiety and con- 
cern, and she directed her energy into mal- 
adaptive channels. She talked very openl. 
and freely concerning the problem outside 
the school; she attempted to force the par- 
ents to do her bidding, and she reacted in a 
negative fashion to the child. In addition 
this teacher was extremely critical and upset 
with the client’s family since it did not fit 
a her rigidly developed set of social values. 
hatte a a meeen on that the child’s 
a ek a) a shen a isturbance, verbalization 

f 3 5 sexualized behavior were 
quite disconcerting to the teacher. She re- 
og by punishing him or by subtly rejecting 
him, although her conscientiousness and anx- 
iety caused her to be constantly involved in 
his problems in an attempt to find solutions, 
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The mental health consultant appeared to 
have done a number of things which seemed 
to have helped in this situation: 

He focused upon the child as the primary 
area of concern for the teacher in an attempt 
to divert her energy from acting out with the 
parents or outside the school. 

He attempted to interpret the child’s basic 
needs to the teacher in such a way that she 
could begin to accept him, not through the 
stereotype of a “bad boy,” but through more 
objective perception of a disturbed, unhappy 
child who needed a stable adult relationship. 

He tried to help the consultee feel that if 
she actually did come close to this child she 
would not be contaminated with his disturb- 
ing influence, but instead, that she would be 
playing an important role in helping him. 

The consultant helped the teacher feel 
more secure in her role as a teacher of young 
children, when she had not taught them for a 
long time, by implying that being conscien- 
tious and working hard at her job was not 
necessarily a poor trait but very useful to 
children, especially if this provided them an 
emotional atmosphere in which they could 
learn, 


On the other hand, there were things that 
the consultant did not do: 

He did not become involved in the school 
hierarchy and have to play the role of “pun- 
ishing” the teacher for her breaking of case 
confidentiality. 


He did not go into the meaning of “bad 
voices” and the deep anxieties this engendered 
in the teacher, Instead 


certain positive as 


“traps” 

for spe- 
cific methods of handling the child and his 
he crisis 
manipula- 
seful long- 
nature. In- 
the child’s 
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problems and helped the teacher work through 


her feelings concerning her relationship to the 
child. 


Finally, it should be stressed that bee 
this area of mental health consultation a 
mands psychological skill and the aiy a 
control one’s own anxiety. The flow of in rf 
mation must be evaluated with regard to E 
degree of reality distortion. The social a 
tem of the school building, school be 
and larger community must be kept in E E 
as a broad frame of reference. The eo 
ant must be continually aware of w S 
changes in behavior, or other psycho pe, 
manifestations. Last, but not least, he ri 
know how to apply his consultative ue 
niques to their best advantages so en team 
main a key member of the mental healt! aches 
in the development of preventive aP adie 
to emotional disturbances in school chi 
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THE RELATIVE CONTRIBUTION OF FOUR KINDS 


OF DATA TO ACCURACY I 


N PERSONALITY 


ASSESSMENT" 
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Ferg 


Does the information available to the clini- 
‘al psychologist through his tests and other 
resources, as in the psychodiagnostic process, 
Provide him with a significant amount of m 
derstanding of the patients about whom 2 
'S asked to make judgments, descriptive and 

‘Agnostic statements, and for whom he is 
asked to make decisions? This question im 
Plies others: (a) if significant insights on 
Patients are possible via the information ei - 
able to the psychologist, which kinds of da 
“ontribute most to an adequate level of id 
derstanding, (b) what is the relationship re 
‘Ween the amount of data available to 5 
clinician and the degree of insight he poo 
and (c) is it possible to identify mos dae 
cient batteries of tests and/or sae ite 
More precisely, we see that it is not on Me 

ata themselves in which we are EF om 

Ut the data as they are used byi = Da 
hologist. As Kelly (1954) has noted; a 
troduction of the human element mto 


iques 
a hat the techniqu 
et process means t validity 


action between data and user. 
isserta- 
` This paper is based upon the otara oe 
on of the author at the University 5 fat he i- 
© wishes to thank William Schofield Ot fanning 
"aluable assistance and encouragemcr vices of the 
and completing the study. Also, the E gine Clinic, 
trainees and staff at the VA Mental Hyer and es- 
et Snelling, Minnesota, were jndispen: “ 
eci jated. wR: A 
A the Veterans Adminis ra th aA 
Shelling, Minnesota, and currently affiliate 


niversity of Minnesota. 


ti 


us Falls State Hospital, Minnesota 


Hypotheses 


1. Clinicians are able, on the basis of psy- 
chological test, history, and interview data, 
to describe psychiatric patients more accu- 
rately than does a stereotyped personality 
description obtained by reference to the pre- 
vailing conceptions of the typical or “aver- 
age” psychiatric patient. , f 

2. (a) Psychological test, history, and in- 
terview data are not of equal value in terms 
of their contribution to diagnostic and de- 

ripti ccuracy. 
ae ‘Of the Tibie tests used, that 
which is designed to tap the inner, uncon- 
scious, and genotypic facets of personality 
yields a greater degree of insight into pa- 
tients, and a higher level of accuracy of judg- 
ments. . , n 

3. There is a positive relationship between 
the amount of data available about a patient 
and the accuracy with which judgments, in- 
ferences, and diagnostic statements can be 
made about him. The information conveyed 
about a patient by each kind of data is addi- 
tive, each succeeding datum increasing the 
accuracy of judgments. 

4. Although there are differences among 
the kinds of data with respect to their use- 
fulness or “validity,” clinicians differ with 
respect to their success with the available 
techniques or data. 

5. Because psychodiagnostic techniques (es- 
pecially psychological tests) reveal the covert, 
often unconscious apsects of personality, the 
judgments and inferences made about pa- 
tients’ personality characteristics by psycho- 
diagnosticians will agree more closely with 
psychotherapists’ perceptions of those patients 
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after more extended -therapeutic contact with 
them than with the therapists’ impressions 
after only a moderate amount of such contact. 


Method 


Patients and instruments. Applicants? to a Vet- 
erans Administration mental hygiene clinic were 
screened during the intake process for (a) judged 
“stayability” in individual psychotherapy, and (b) 
availability for a psychological evaluation of ap- 
proximately six hours in length. The psychological 
examination consisted of the following procedures: 
each patient completed a four-page Biographical Data 
Sheet (BDS) and the booklet form of the Minne- 
sota Multiphasic Personality Inventory (MMPI). 
He was also interviewed and given a Rorschach 
test by the clinical psychologist who was the 
nostician” and who performed the subsequent 
cal Q sorts. 

The data were made available to the clinician se- 
quentially, and he performed a Q sort of 97 items 
describing phenotypic and genotypic personality and 
behavioral characteristics after considering each of 
the four major groups or kinds of data. The bio- 
graphical data were uniformly made available to the 
clinician as the first group of data, and the initial 
Q sort was performed on that basis alone. Six Se- 
quences of data were possible with the remaining 
three kinds of data, and in order to exhaust the 
number of sequences each of the (five) diagnos- 
ticians examined six patients, each patient being 
studied by a different sequence of data. The se- 
quence followed in a given clinician’s first case was 
assigned by random selection, and each subsequent 
Sequence by random selection from among the re- 
maining (unused) sequences. It was understood that 
the four Q sorts in each instance would not represent 
interpretations of the specific dat: 
ately preceded them, 
data which has been 


“diag- 
clini- 


p e! a cen seen for a total of 10 
interviews,* his therapist 5 Performed a (criterion) 


ST] 
of impairment ranged from 0% to 100 panee 
10%). 

4 In three cases the therapist’: 
after the eighth therapeutic in 
conclusion of the study. 

5 Thirteen therapists drawn from 
major disciplines in the clinic (7 


s Q sort was obtained 
terview because of the 


each of the three 
clinical psycholo- 
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Q sort of the 97 items used by the diagnosticinn 
in describing the patient. Comparisons between a 
diagnosticians’ four clinical sorts and the thepa sti- 
10th-hour Q sort descriptions of the patients ¢ for 
tute the major data of the study. In adang or 
those patients who remained in therapy for ion 0 
more interviews, an additional Q sort denpa time 
them by their therapist was obtained at the bat, 
the study was terminated. The range of gs 
terviews in this group was from 15 to 49. cor that 
sons between Q sort descriptions obtained petween 
time and the 10th-hour Q sorts as well as be sorts 
the former and the diagnosticians’ four clinical idera- 
were made. As a further methodological PART 
tion, in 10 of the 30 cases a re-sort from Aai 
pist was obtained between the 10th and 11th btained 
interviews or after the terminal Q sort was i inter- 
in those cases remaining in therapy beyond x our 
views. The correlations between the 1000an 
sorts and the re-sort, and between the tera reli- 
sort and its re-sort are considered a measure 
ability. : the 
Five clinical psychologist trainees comprised cli- 
group of diagnosticians (hereafter referred $ raining 
nicians) . They were at different levels of ram): 
(within the limits of the doctoral training P rainees 
but had all been employed by the VA as 
for at least one year. F, ool 
Selection of the Q sort item pool. The itera o 
finally selected for use in the present study 95 items 
tained from a larger pool ® consisting of are 
gathered from a variety of sources, pal Bailey 
studies by Halbower (1955), Block am Murray 
(1953), and others. Further, each of the ial 
(1938) needs was included as a separate 1 rious 
were the Psychoanalytic defense mechanisme  nostie 
of the diagnostic categories found in the ne - 
and Statistical Manual (American psychia 
ciation, 1952) were represented by items, aS sociate! 
personality and behavioral characteristics a iescribe 
with the more common MMPI code types 
by Hathaway and Mechl (1951). aa 
Each of 11 psychology trainees performe 
describing their conception of the typical ) 
tient (referred to psychology for yes 
sorts were summed to form a composite fro’ 
was derived a Mean Average Patient (M 
scription. The MAP description was given tomize 
of the five clinicians in the study who deko ae the 
the distribution at the point where he felt t to the 
items became, by and large, false with repes Ee m- 
typical MHC patient, (This procedure was a5 rth 
ployed by the clinicians when performing the MAP) 
clinical sort for each patient.) The stereotype (thera: 
description was compared with the criterion vel of 
Pist) Q sort for each patient. The average 


d 


Q sort 
C pa 
These 
which 
vides 
o each 


jo 

gists, 4 psychiatrists, and 2 social workers) vee t5 
volved in the study. About one half of the p3 

were seen for therapy by Psychologists. 1 bY 

®This pool was made available to the autho be 

P. E. Meehl. The 97 items used in this study m4¥ 

made available upon request. 


n 


Contribution to Accuracy 


iant between the two over the sample of 30 
pected level) considered the baseline (chance, or ex- 
evaluated. against which the clinical sorts were 
ape and results of the Q sort item selec- 
oe E as follows: four pairs of judges (one pair 
iagnosti of the four data groups included in the 
manostic battery) rated each of the 295, iteme ip 
“of sn pool. Each item was judged as “suitable, 
ing, ee suitability,” or “unsuitable” to rat- 
Specific hin basis of the information conveyed by the 
trarily nd of data. The judges’ ratings were arbi- 
so Mees weights of 2, 1, or 9, respectively, 
each q each item had a possible score of O to + for 
rating = group, and from 0 to 16 as an over-all 
Selected a it was desirable that the items finally 
Utilized ave relevance to each of the kinds of data 
the Jar by the clinicians, items were selected from 
ing ee pool on the basis of (a) a high total rat- 
ability) and (b) specific pertinence (judged suit- 
e used to one or more of the four types of data to 
Ubse by the diagnosticians as the basis for their 
ieee sortings. A total of 94 items was s0 Se- 
Panded ne two of the items were modified and sa 
nal orate five separate items, thus comprising ie 
tempt -item pool used in the study proper. An a - 
judg, 2S made to equate the final pool with i 
fears to have particular pertinence to each spe F 
the of data. The extent to which an equating K 
a pool for items pertinent to each data ty pe yei 
ro: Mplished is indicated by the data in Table 
MMD Table 1 it may be seen that the hemia 
Rh and Rorschach were roughly comparab Sn 
While of their item representation 17 the op oy 
iles the BDS was distinctly underrepresen ar 
data. judged to have pertinence to that sour 


Asa fi tation in the 

: urther measure of the represen 

le data types; 

Pool of i ant to each of the data type» 
items releva! d in the final pool 


bsamples of items containe > 
Kens ned rated by each of the two judges 7 
Y uitable” to a specific data type may be compare 
vith the total pool in terms of item placements 
smeans and variances) in the stereotype (MAP) 
Ort, The 97-item Q sort distribution utilized in the 


Table 1 

Judges’ Ratings of the 94 Q Sort Items peas 
elected from the Larger Pool in ‘Terms of Their 
Suitability” to Rating from the Specific Types 

of Data Utilized by the Clinicians 


Sum of the Two 
Judges’ Ratings Sum X 
: Mf ee 7 
Kind tD AOA 2 1 10 Frequency % 


Dine ee sd, 1) 202 28.8 
MMPI 45°22 16 5 6 283 27.3 
Rorschach 43 25 10 12 4 279 26.9 
BDS 15 16 20 25 17 176 17.0 


in Personality Assessment 485 


final sortings yielded a mean of 6.0 and a variance 
of 4.54. The means of the four subsamples of items 
were as follows: Interview, 5.52; MMPI, 5.36; Ror- 
schach, 5.61; and BDS, 7.53. The variances were: 
5.06, 4.28, 5.56, 5.05, respectively. An analysis of 
variance of these values yields an F of 3.76, which 
indicates statistically significant differences among 
the item subsample means. By ż test analyses it was 
shown that the BDS item subsample differed from 
the remaining three samples in the mean placement 
of items in the MAP sort. It would appear then, 
that the 97-item Q pool was underrepresented with 
items inferable from the BDS, and further, that the 
small sample of items “suitable” to rating from the 
BDS which was included in the total pool could not 
be considered a random sample from the total item 
pool, but rather, contained items which tended to 
be placed toward the less descriptive end of the Q 
sort continuum in the MAP sort. 


Results and Discussion 


Reliability of the Q sort. The reliability 
sorts were performed by the therapists on 
different days, and were not separated in time 
by a therapeutic interview with the patient. 
The number of days between initial sort and 
re-sort for the 10 cases ranged from 1 to 42, 
with a median of three days. The two sorts 
were correlated and yielded a range of reli- 
ability coefficients from .795 to .936 (median 
(858, mean .866). There was little apparent 
relationship between the magnitude of the 
reliability coefficient and the length of the 
time interval between sorts, perhaps because 
of the small dispersion of the latter. These 
data are interpreted as indicating satisfactory 
reliability of the Q sort. ‘ 

Results of testing Hypothesis 1. (a) In 21 
of the 30 cases the correlation between the 
final clinical sort and the therapist’s criterion 
description for that patient exceeded numeri- 
cally the correlation between the MAP de- 
scription and the latter. The sign test indi- 
cates that this proportion would arise on the 
basis of chance alone in less than 5 out of 
100 instances. (b) In 15 of the above 21 cases 
the observed differences between correlations 
were statistically reliable (P < .05). (c) In 
9 of the 30 cases the MAP (stereotype) de- 
scription exceeded the validity of the final 
clinical sort. Four of the nine differences wer 
arney reliable. (d) In 21 of the 30 esi 
ee aes of items agreed upon by clinician 

> erapist on the true-false dichotomy ex- 
ceeded the comparable figure in the case of 
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Table 2 


Validity Coefficients of Six Subgroups of Data 


3e 


Biographical Data Sheet plus* 


R 
Complete Battery minus 


Interv. MMPI Rorsch, Interv, MMPI Rorsch. 
eae 272 384 347 343 348 a 
Mean validity 381 385 ALL 402 103 30! 
of the BDS alone | 
Validity of the 
data subgroup 
Range 282 to .734 120 to .539 016 to .350 016 to .627 220 to .607 
Median 610 410 305 456 453 
Mean 566 378 368 403 450 
*N 


= 10 different cases in each subgroup, 


the MAP description/therapist comparison. 
Again, the sign test yields a probability of 
less than .05, which indicates a significant 
difference in favor of the clinical sorts over 
the MAP description. (e) The average per- 
centage of the 97 items agreed upon (over 
the 30 cases) by clinician and therapist was 
66.0, whereas the comparable figure in the 
case of the MAP description/therapist com- 
parisons was 60.0. The difference between 
these two means is statistically reliable Pg 
:05). (f) For the entire sample of 30 cases 
the average validity coefficient of the final 
clinical sort was -480, w 
lidity coefficient of the 
description was .340, The 


these mean values is stati 
< 01), 


In each of the above analyses, evidence of 
the superiority of the clinical sorts over the 
stereotype description js observed. Although 
the final clinical sort (which represented a 
clinician’s integration of all the available data 
on a patient) did not always result in better 
than chance descriptive accuracy, it did so in 
a majority of the cases, and in one half of 
the cases the greater accuracy of the clini- 
cal description 


Was statistically reliable, Hy- 
pothesis 1 is accepted. 


Results of testing Hy 
lidity coefficients of six pb. 


hile the average va- 
MAP (stereotype) 
difference between 
stically reliable (P 


pothesis 2, The va- 


i atteries or subgroups 
of data are reported in Table 2, The data in- 
dicate that although the subsamples of pa- 


thus exhausting the total sample of 30 patients. 


at to 08 
604 
1595 
O ae 
k ble in 
tients seemed to be roughly compara 


terms of the degree to which their B 
tributed to descriptive accuracy, x ect t0 
were not markedly dissimilar with resP 


con 
they 


uite 


which 
wing 


h jen 
or BDS plus Rorschach validity coefficiet i 


fficie? 
group: 
1p 
he mea” 


(.566) was significantly greater tag z 05): 
in either of the other two groups ( ar 


averae 
lidity was reliably greater than the - 


ga i 
group (P < .01) and, in addition, aie of 


di 
cantly greater than the average vali 


sub- 


the BDS alone for the 10 cases in the * e 


wel" 
group. Further, considerable differences, scal 
observed at the point of the thir ta 
sort, depending on which kind of ae se 
omitted from the battery. In only O^ A 
from each of the Battery minus ger 
and Battery minus MMPI groups di 


ca 

in 

d i was 

view 
the 


tq 
% $ edi? 
validity coefficient equal or exceed the ME- af 


al 
coefficient in the Battery minus Rors¢ ey 
ough the average V4 e 
of the three group? jhe 
ge validity coefficient ° 
n for the 10 cases in 


group. Further, alth 
coefficient in each 
ceeded the avera; 
MAP descriptio 


dit 


that 
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ae in only the Battery minus Rorschach 
cally r ine the observed difference statisti- 
a e (P < .01). Finally, the mean 
(. 595) minus Rorschach validity coefficient 
mean v: ee significantly greater than the 
two ee idity coefficient in either of the other 
and ale (P < .05). In view of these facts, 
average may be seen from Table 2) since the 
orca validity coefficient of the BDS plus 
see did not exceed the average Va- 
$ Y coefficient of the BDS plus MMPI, 
tect 2,, which implies the greater va- 
i = the Rorschach relative to the MMPI, 

A confirmed. 
tive further method of elucidating the rela- 
the Sse or usefulness of the data used in 
< The oe process is reflected in Table $; 
of q requency with which each of the kinds 
whi ata immediately preceded the Q sort 
ich yielded the highest validity coefficient 
fae four obtained during the diagnostic 
riety was tabulated. In addition to the four 
seri S of clinical information, the MAP de- 
Ption is included in the tabulations. Fi- 
rane the ranks of one through five are given 
(inverse) weights and, when multiplied by the 
served frequencies and summed, the data 


re ranked in terms of their contribution 
r e maximum validity obtained during the 


‘agnostic process. 

. Several aodan trends may be observed 

m the data reported in . First, 
tequency with which the Interview yielde 
e greatest agreement h the therapist 

(40% of the cases) is striking- In addition 


wit 
triki 
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to a possible explanation in terms of the simi- 
larity between this data type and the criterion 
(the fact that diagnosticians’ interview im- 
pressions were correlated with therapists’ in- 
terview impressions), the possibility is sug- 
gested that the diagnostic interview was in 

ite useful technique which con- 


itself a qu 
tributed at least as much to the diagnostic 


process as the best available “test” in the 
conventional sense. A second important fact 
reflected in Table 3 is the distribution of the 
MAP validities. It would appear that the 
stereotype description tended either to fit the 
patient very well (better than the tests) or 
to miss him almost completely, so that any 
specific test or history data about him af- 
forded a more accurate description than did 
the stereotype. In 27% of the cases no single 
test or combination of data led to a more ac- 
curate description of the patient than was af- 
forded by the stereotype. That the latter did 
not obtain by virtue of the tests’ failure to 
describe the patients well, but rather, was due 
to the absolute accuracy of the stereotype 
description in many instances was attested to 
as follows. In the eight cases where the latter 
yielded the highest validity coefficient, the 
correlations ranged from .368 to .705 with a 
mean of .550, which is just about as good as 
even the best test batteries did in a given 
series. There appeared then, to be a subpopu- 
lation of patients for whom the MAP descrip- 
tion was quite accurate, and for whom little 
further data were needed in order that they 
be described as adequately as the psycholo- 


Table 3 


y with which Each of 


The Frequenc; 
The Freq Break 


Im mediately 


the Kinds of Data, and the Stereotype 
ded the Highest to Lowest Validity Coefficients i 
h of the 30 Diagnostic Cases 


in Eac 
Magnitude of 
Validity eig! Interv. MMPI 2 
Coefficient 3 Donos , Rorsch. BDS MAP 
= 4 12.0 5.0 
Highest 3 8.0 70 ce 4.0 8.0 
2nd 2 5:5 8.0 af 5.0 2.0 
3rd 1 15 7.0 pa 3.5 0.0 
4th 0 3.0 30 oa 10.5 5.0 
Lowest irei 84.5 A 70 15 
yeight -5 64.0 : 5.0 
Sum of Wels 5y 60.0 48.5 
Frequency ` 43.0 
pi ze i 
= wa 258-39; df = 16; P < 01. 
ote? 
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gist was able to do on the basis of an ex- 
tended workup. On the other hand, there was 
a larger subgroup which was quite unlike the 
MAP description, and for whom additional 
data were needed in order that they be accu- 
rately described or diagnosed. 

The data presented in this section, plus 
several of the comparisons discussed in the 
previous section, may be summarized by 
means of a ranking of the batteries reviewed 
above in terms of their average validity co- 
efficients (Table 4). The average validity of 
the MAP description may be construed as 
the baseline or chance level of accuracy. 

From the preceding, it may be seen that 
the kinds of data used by the clinician dif- 
fered with respect to their contribution to 
diagnostic accuracy. By way of summarizing 
the relationships among the kinds of data 
used it would appear that (a) the superior 
batteries (in terms of agreement with the 
therapist) were those which included the In- 
terview, (b) omitting the Rorschach test from 
the battery was associated with higher va- 
lidity of personality descriptions than when 
it was included, and (c) heavy reliance on 
the Rorschach was associated with no better 
than chance accuracy of personality descrip- 
tions. Hypothesis 2,, which postulates differ- 
ences among the data in their contribution to 
accuracy in personality description, is ac- 
cepted. 

Results of testing Hypothesis 3. Hypothe- 
sis 3 implies that as data are added during 
the course of the diagnostic process the ac- 


Table 4 


Average Validity Coefficients of the Several 
“Batteries” of Data 


Average 
Validity 
N Coefficient 


Battery (Basis 
of Q Sort) 


Battery minus Rorschach 


10 .595 
BDS plus Interview 10 ea 
Complete Battery 30 480 
Battery minus MMPI 10 450 
Battery minus Interview 10 403 
BDS alone 30 396 
BDS plus MMPI 10 378 
BDS plus Rorschach 10 .368 
Stereotype (MAP) 30 340 
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Table 5 


: ition of the 
The Relationship between the Ordinal Pos eae 
Q Sorts and Their Average Validity Coe 


(N = 30) _ (H 
Mean 
Validity è 
Q Sort Coeficien Sa 
= á —_ 
Individual clinician’s 289 
“average patient” sort 340 
MAP description s 
eal sorts 306 
S! 
2nd a 
3rd 5 
480 
4th SS 


. qividuals 
curacy of judgments about the indivi 
studied increases. Further, it was rit the 
sized that each kind of data used quent 
Study increases the validity of the subsi sa 
Q sort over that of the previous Q 5 
it is added to the battery. ver the 

From Table 5 there does appear, ‘tive te 
entire sample, to be a consistent eae con 
lationship between the amount of da ‘hich 
cerning patients that clinicians had oat of 
to base their judgments and the accu of the 
such judgments. However, in spite in VO" 
consistent trend toward increments dat@ 
lidity as a function of the amount s from 
available, the absolute improve? i. quite 
initial (BDS) to final clinical sort Wë ts 
small. While, on the average, the B riterio” 
accounted for about 15% of the ke entire 
variance, the sorts on the basis of E of that 
battery accounted for less than 25% ai 
variance—an absolute gain of less tha d 
fewer errors in judgments (accuracy 
scription). , idity with 

Although the actual gains in vali te ve 
additions of data were minimal, there jon of 
good evidence that clinicians’ percep iad 
patients rapidly crystalize as a functi 
the amount of data (Table 6). «jas 

Table 6 shows clearly that the clini A 
changed their impresions of a patient 1s i 
less with further increments to the aval 


ow 
data. While they may have changed S 
their “average patient” conception on thaing 
sis of a patient’s BDS 


they were unwi 
z the: 
to greatly alter their statements after 
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fe onsidered two or three kinds of data 
Patio a patient. in view of the rapid crystali- 
Sd n - clinicians’ perception bf patients, 
nets y slight improvement in validity as a 
avail e of increments in the amount of data 
available, Dailey’s (1952) finding, that di- 
ter oa ee this type of enterprise begin to in- 
ee their early inferences as facts as they 
De equired to make further judgments, ap- 

os altogether plausible. 
ties way of further analysis, the number of 
and = addition of the MMPI, Interview, 
crea, orschach, respectively increased or de- 
ae the validity of the clinicians’ judg- 
Cont S may be interpreted as evidence of their 
side tibution to the diagnostic battery. Con- 
Wallan the absolute numerical value of the 
son ity coefficients as the basis of compari- 
idit it may be seen that a given Q sort va- 
validi should either exceed or be less than m 
nu ity of the preceding Q sort in an equa 
V “ig of cases if there were no differential 
alue of the specific data class in the battery. 
c e chance frequency with which each data 
c ass should yield a higher Or lower validity 
sofficient than the immediately preceding 
ce is 15. Tabulation of the actual frequen- 
pe shows that the Rorschach Q sort yielded 
t (numerically) higher validity coefficient 

an the Q sort immediately preceding it in 
9 cases, the MMPI in 13, and the Inter- 
yew in 25, According to the sign test of sig- 
nificance, only the last value is reliably dif- 
erent from the expected value of 15. These 
ata indicate that whether oF not the data 
Class added to the validity of an existing bat- 
tery depended on the nature of the data. In 


Table 6 


Average Intercorrelation of Successive 
Q Sorts by the Diagnosticians x 


Mean | 
Tntercorrelation 


Q Sort 
Clinician’s “average patient” sort 459 
’ vs. his 1st clinical sort 
Me clinical sort vs. 2nd clinical sort 698 
Nd clinical sort vs- 3rd clinical sort 805 
.850* 


3rd clinical sort vs- 4th clinical sort 


* Approximates the median reliability coefficient of the Qsort- 
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Table 7 


Validity Coefficients of the Interview when it was the 
Second, Third, and Fourth Data Group Considered 
in the Diagnostic Process 


(N = 10 in each sample) 


Average Average 
Ordinal Validity Validity 
Position Coefficient Coefficient 
of Interview of Sort of Final Sort 
2nd 566 2542 
3rd A80 477 
4th .412 -412 


this analysis, only in the case of the Inter- 
view did an increase in validity over that ob- 
tained on the basis of previously considered 
data accrue in a significant number of cases.’ 
Finally, although the Interview tended to 
add to the accuracy of judgments made on 
the basis of test and other data, the extent 
to which it contributed depended upon how 
much data about the patient had already 
been made available to the clinician. That is, 
if the Interview was held early in the diag- 
nostic process a much greater contribution to 
the validity of the clinician’s judgments was 
made than if the Interview was held later, or 
was the last procedure employed. Since there 
is evidence indicating that clinicians tended 
to crystalize their thinking about patients 
early in the diagnostic process regardless of 
the specific data on which their judgments 
were made, it appeared that if the Interview 
was a part of the early body of data on which 
closure was based, a relatively high level of 
validity obtained, not only at that point, but 
also at the completion of the diagnostic proc- 
ess. However, though the Interview was a 
powerful diagnostic technique, it could not 
overcome the false leads obtained early in 
me Teete process on the basis of the less 

valid measures or i 
tains the data on Ae sade ER 
ied. onclusions are 
eee the relationship between the 
available to clinicians and the 


7 
a Fiona be noted that sequence or ordinal po- 
a: e series was equated for all groups, since 
eee see wae computed on the basis of all 30 
oes s ata type,- then, appeared as the second. 
, and fourth group an equal number of times. i 
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accuracy of their judgments appeared to i 
complex rather than as simply stated in the 
hypothesis. When all cases and all data groups 
were considered, there appeared to be a con- 
sistent trend toward increased accuracy (va- 
lidity) as further increments to the data were 
made. However, the above relationship is 
seen to depend largely on the nature of the 
data which were added to the battery. In the 
case of the Rorschach, decrements in validity 
were as frequently observed as were incre- 
ments when that test was added to the bat- 
tery, while the Interview almost invariably 
added to the accuracy of the diagnostic judg- 
ments, the degree of the latter being related 
to the point in the diagnostic process at which 
it occurred. 

Results of testing Hypothesis 4, Hy 
sis 4 states that individual differences 
be observed among the clinicians in te 
their success with the kinds of d 
The analysis in this connection 
straightforward one, namely the t 
the frequency with which eac 
highest validity coefficient in ea 
diagnostic cases followed the in 
each of the four data types. Ta 
the pertinent data. 

First, it should be noted that with the ex- 
ception of the BDS, which was routinely ana- 
lyzed first and without benefit of other test 
data being available, sequence or ordinal po- 
sition in the diagnostic Process is not a sig- 
nificant factor in the distribution of validity 
Scores, since the figures were computed on 
the basis of the entire sample of 30 cases, 


pothe- 
would 
rms of 
ata utilized, 
is a rather 
abulation of 
h clinician’s 
ch of his six 
troduction of 
ble 8 contains 


Table 8 

The Frequency with which Ea 
Produced the Highest Validit: 
Cases Studied | 


ch of the Data Groups 
y Coefficient in the Six 
by Each Clinician 


VA Training lighest Validity Coefficient 


Classification Ror- Inter- 

Clinician (year) BDS MMPI schach view 
A Iv 1 3 ey 

B it 2 0 0 4 

c 1I 2 2 1 1 

D HI 0 0 0 6 

E I 2 1 (0 3 
Total 7 6 3 14 
SSS Se 
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which indicates that each of the ee | 
Rorschach, and Interview was second, tl E 
and fourth an equal number of times (10) 
the sequence. e 
The cell frequencies in Table 8 may i 
evaluated for significance by means EE 
parametric test. Since, for each C H 
there were six trials (patients) and om f 
types, the mean expected frequency Pe spe 
is 1.5. Further, the probability wa a sigh- 
cific data group (test) would yield pa one 
est validity coefficient in a given case eing 
in four (.25), of the same data group 9375; 
highest in any two cases (.0625) (15) er in 
in any three cases (.015625) (10) = 039, in 
any four cases (.00390625) (10) = ani ‘an 
any five cases (,0009765625) (4) = -0 it may 
in all six cases 0002. From these e r cli- 
be said with statistical confidence fei with 
nicians B and D were more successu 
the Interview, relative to their use e 
other data, than were clinicians A 7 
relative to the latter’s use of the pie 
Although these relationships are al" is 
from a descriptive point of view, ! 


1 


data: 


clinician D obtained his greatest 
the basis of the Interview in eac ae 
could have come about as readily ee so 
of skill with the other data as fro! 3 
unique interview acumen.’ -anamal dif- 
A further matter relating to indivi ns theif 
ferences among the clinicians conc yaoi 
over-all level of accuracy in the aa was 
enterprise. An evaluation of this my co- 
accomplished as follows: the 30 eae were 
efficients obtained by the five clinicia ach 
ranked in terms of their magnitude, na 
clinician’s distribution of six cages 
obtained. An analysis of variance ait ci 
plied to the five distributions of vali f 


h insta? 


by 
A sted 
8A further interesting possibility is sugse ating 


-end indica 
the data in Table 8, namely, that a trend aperiens 
a relationship between the amount of €s 0 


z eg ree 
(level of training) of the clinician and his deg ous! 


ela” 
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Table 9 
Validity Coefficients of the Five Clinicians’ 
Q Sort Diagnostic Judgments 


VA Training 


Validity Coefficients 
Classification 


Clinician (year) Range Mean Median 
i ia 2 —— = 
2 IV 361 to.659 531 -533 
a Ill 327 to 632, 475 400 
2 HI 293 to 535 -523 
2 Ii .125 to « a58 28 

: I 123 to 387 429 
— 


efficient ranks, and yielded an F of 12.8 in- 
dicating a probability of less than .001 that 
the distributions of ranks represented random 
Samples from a common source. A # test 
analysis of the individual distributions of 
"anks indicated that clinician E produced 
Validity coefficients significantly lower than 
Ose of the other four clinicians. Further, 
only two of clinician E’s six validity coeffi- 
Clents exceeded the lowest median coefficient 
obtained by any of the other clinicians. Al- 
ough it would have been desirable to pi 
e degree of experience and the level of the 
Clinicians? training to their relative success = 
© diagnostic enterprise, the range of ed 
ence (training) among the five was goie : 
stricted, However, as indicated in Tane i 
ne fourth year trainee had the tigen Sa 
dian validity coefficient, while the yer a 
rainee had the lowest coefficients. Idea a PA 
Course, a critical evaluation of the f a ch 
Power or usefulness of various kinas o hi s 
and a definitive statement of the apea n 
tween amount of experience g at re- 
training) and diagnostic accuracy, wou a 
{ire study or a group of thoroughly cag ae 
Toadly experienced clinicians, rather ining 
Persons at the initial phases of their training 
Such as were represented in this study. cites 
Results of testing Hypothesis 7 a 
sis 5 states that the agreement between ant 
Nosticians’ judgments about Lee atl ae 
hose made by the patients’ psychother huni 
Would increase as a function of the nee 
Of therapeutic contact the latter had wit 
Patients, 
For 10 of the 30 patients, criterion Q Sor 
Were obtained from the therapists at & pons 
in therapy well beyond the 10th hour, w 


sorts 
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point at which the original criterion Q sorts 
were routinely obtained. The number of ther- 
apy interviews which had taken place at the 
time of the terminal Q sort ranged from 15 
to 49 (median of 23). In each case the cli- 
nician’s final sort was correlated with the 
terminal criterion sort of the therapist and 
the distribution of such coefficients was ob- 
tained. The coefficients obtained between the 
clinical sorts and the 10th-hour sorts for the 
10 cases were also noted and a comparison 
between the two sets of data is interpreted as 
reflecting the relationship between amount of 
therapeutic contact and therapist /diagnosti- 
cian agreement.” The data in this analysis do 
not support the hypothesis as stated. The av- 
erage of the validity coefficients of the cli- 
nicians’ Q sorts was the same when com- 
pared with therapists’ judgments based upon 
more extended therapeutic contact, as when 
compared with therapists’ sorts based upon 
only 10 interviews. 


Summary and Conclusions 


The relative contribution of four commonly 
used kinds of clinical information to the de- 
scription of the personality characteristics of 
male veteran psychiatric outpatients was 
studied. 

Five clinicians studied the group of pa- 
tients from a psychodiagnostic point of view, 
and performed four Q sorts of items describ- 
ing the patients’ personality characteristics 
and current psychiatric status. Increasing 
amounts of tests and other relevant data con- 
cerning the patient were made available to 
the clinicians sequentially. The data consid- 
ered by the clinicians included (a) a four- 
page Biographical Data Sheet (BDS), (b) 
the patient’s MMPI profile, (c) a Rorschach 
protocol (administered, scored, and inter- 
preted by the clinician who performed the 
four Q sorts), and (d) a diagnostic interview 
conducted by the clinician. In each case, the 
sequence in which the clinician obtained and 


9 The therapists’ terminal criterion sorts were also 
compared with the corresponding 10th-hour criterion 
sorts. The resulting correlation coefficients ranged 
from .580 to .850 (median .734), which suggests that 
the therapists did not markedly alter their impres- 
sions of their patients (as reflected by the Q sort) 
between the 10th hour of therapy and the point at 
which the terminal sort was performed. 


492 


considered each of the above four kinds of 
data was specified. Although the BDS was 
always the first data-group considered and Q 
sorted, the other three kinds of data were ar- 
ranged in the six possible sequences and each 
sequence was followed in one, and only one, 
diagnostic case per each of the five clinicians. 
A Q sort was performed after the clinician 
considered each kind of data, and the final 
sort represented the clinician’s integration and 
interpretation of all the available data con- 
cerning the patient under consideration. 
Each patient was assigned to a psycho- 
therapist in the usual clinic manner, with the 
exception that the psychological test results 
and the usual written report were not made 
available to the therapist. After the patient 
had been seen by the therapist for 10 inter- 
views (in three cases for only eight inter- 
views) the therapist performed a criterion Q 
sort, describing the patient as he saw him on 
the basis of his therapeutic contact and what- 
ever record material was available on him, 
On the basis of the comparisons between 
the diagnosticians’ and therapists’ Q sort de- 
scriptions of patients, the following conclu- 
sions were drawn: 
1. Although in some instances a stereotype 


he most accurate 
btained, bettering 
ents made on the 
available test, his- 
linicians were gen- 
sychiatric patients 
a single stereotyped 
eference to the pre- 
e typical psychiatric 
ng. 


the diagnostic sequence, 

4. Neither the Rorschac 
appeared to increase the y. 
judgments in a significan 
(more frequently than t 
previously established val 


h nor the MMPI 
alidity of Previous 
t number of cases 
hey detracted from 
idity of judgments). 
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a 
5. Biographical data appeared oe 
Promising source of information in ees ai 
assessing the personality characte aa 
Psychiatric patients. The BDS at leas aa 
its own” relative to the other ca a 
though underrepresented in the item ee infor- 
routinely considered without collatera 
mation or data about the patients. A 
6. The relationship between the am a an 
information available to the diagnostik m E 
the accuracy of his judgments is “tne 
rather than linear, and varies ee made 
the particular type (or kind) of date 
available to the clinician. ives with 
7. Clinicians differ among themse E c, 
respect to their over-all diagnostic an the 
and also in terms of their success a in 
various tests or kinds of data utilize 
diagnostic process. + the deste 
8. There was little difference in t! ; 
of agreement between diagnostican at 
therapists as a function of the RRE i 
therapeutic contact (over a certain atients 
amount) the latter had with specific B diag- 
9. The over-all agreement betwee a: dest 
nosticians and therapists was rather aa t 
(mean r= 48), suggesting that 50 pasized 
different frames of reference were emp 
by each. 


t of 
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A NOTE ON THE PO 


STURAL SWAY DISTRIBUTION ` 


FRED HEILIZER ° 


University of Rochester 


The test most often used as a measure of 
Ypnotizability is the postural sway test. Tts 
reported correlations with various depth-of- 
Ypnosis scales range from .50 to -75, with a 
Probable mean of about .70 (Furneaux, 1952; 
Bull, 1933; Weitzenhoffer, 1953). The pos- 
tural sway task involves direct repetitive sug- 
8estions to S that he is falling forward. (Much 
ess frequently used are suggestions to ial 
ackward or alternately sway forward and 
ackward.) The suggestions are repeated io 
Periods ranging from 30 sec. to 24 min. m 
argest single forward excursion is usua ly 
aken as the score. The experimental period is 
Sometimes preceded by @ control period k 
Which S is told to stand still. When bot 
Periods are utilized, the score is usually a 
difference between the maximum excursion it 
each period. 
he resulting distributions are either ‘ee 
fated or U-shaped. These distributions aS 
Sometimes attributed to gross ee Tae 
Procedures, Hull (1933); in reviewing E 
iterature on several of the direct sugges 


bility tests, concludes: 


zide! leads 

A judicious examination of all the epee 

One to the conclusion, however that q distribu- 

deviations from the normal or bell-shap® scales for 

ton are more likely the result of defectiv nstitutional 
Measurement than of any inherent CO 


tendency (p. 101). 


Eysenck (1952), on the othe 
Sumes that the postural sway test, iling wh 
above, has a threshold and a ceiling 


r hand, as- 
as described 
ich 


issertation 
*This paper was abstracted from z Bay reece: 
Submitted in partial fulfillment of the Fo Wendt 
Would like to express my gratitude to A assistance 
and E, L, Cowen for their interest and 4 


transform an underlying normal distribution 
into an apparently U-shaped distribution. 


Method 


During the course of a larger study we 
utilized a more precise measurement proce- 
dure unrestricted by conditions of either a 
threshold or a ceiling. A control and an experi- 
mental period, of 2¥% min. each, were utilized. 
The postural sway test was introduced to S as 
a test of motor activity, no mention being 
made of hypnosis. The S was directed to stand 
with feet together flat on the floor, arms 
folded, and eyes closed. She was told to stand 
there, relaxed, until further directions were 
given. She was also told not to be afraid of 
falling since, if she did fall, Æ would catch 
her. At the end of the control period, the 
following instructions were administered: 


Now, as you stand there, I want you to concen- 
trate on what I’m saying, on my voice. Just stand 
there, relaxed, doing nothing in particular but listen- 
ing to me. Blot everything else out of your mind, 
concentrate on my voice and, as you listen to my 
voice, you will start to sway forward, swaying for- 
ward, falling forward, falling forward. . . . 


The words “falling forward” were repeated 
for 2 min. and 30 sec., with a reminder ap- 
proximately every 30 sec. to “just listen to 
what I’m saying.” 

Permanent recordings of all forward and 
backward movements were made on a 3-to-1 
step-down kymograph drum by means of a 
cord and pulley arrangement attached at one 
end to S’s collar and at the other end to a 
metal stylus. The 6-in. drum allowed a maxi- 
mum sway of 12 in. forward and 6 in. back- 
ward to be recorded. Measurements of devia- 
tions from the baseline were made at 5-sec. 


in this study. i ton, Massa- intervals. The 30 measurements for each per- 
2 Now at the VA Hospital, Northamp'™ iod were averaged, and the difference between 
chusetts. 493 
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Scores 
Fig. 1. Distribution of postural sway scores (N 
forward during the postural sw. 


the two averages constituted the postural sway 
score. If S fell forward the maximum score 
of 40 Yo-in. units (corresponding to 12 in, of 
actual movement) was scored for the remain- 


der of the 214 min. The Ss were 62 female 
college volunteers. 


Results and Discussion 


The resulting distribution is presented in 


Fig. 1. The numbers representing the class 
intervals are the midpoints of the intervals, 
The data, computed in tenths of an inch from 
recordings which were one third of actual size, 
are 344 times as large as the actual move- 
ments or, conversely, the actual movements 
(in inches) are 30% as large as presented 
here. The distibution is markedly skewed to 
the right. The descriptive data for this distri- 
bution (total group) are presented in Table 
1. The chi square indicates a significant de- 
parture from normality, while the £ indicates 
that the sample differs significantly from zero. 


Table 1 
Descriptive Data for Postural Sway 
Total Low High 
Group Group Group 
(N = 62) (N = 40) (N = 22) 
Mean 6.37 —0.15 18.21 
SD 10.82 2.22 10.17 
Median 1.34 0.03 16.14 
Chivsquare 56.48" 3.15 om 
(df = 4) 
r 4.60* 0.42 8.21* 


* Indicates the .05 level or better, 


Na 
on g 
| 


= 62). (“o” denotes Ss who fell 
ay instructions.) 


an 
A further examination of Fig. 1 ae 
unusual situation: the lower yee uppe" 
distibution (N = 40), divided from oe 
third of the distribution at the aria ibai 
percentile), seems to be normally a grou 
about zero. The chi square for the ei 
(Table 1) is not large enough to oe the 
assumption of normality (P = .60), ull by: 
# is not large enough to reject the we of 
pothesis of no departure from a t for de- 
zero (P = .70), The chi square tes ute 
Parture from normality was not a 
the high group because of the small at 
for this group indicates that the mea 
nificantly different from zero. ipility that 
The above results raise the pin a com” 
the postural sway distribution may D dem 
posite of two distinct groups, one gro grou? 
se: 


A i: 
OE a g 


et 
is si& 


onstrating no response and the gee 
demonstrating a marked positive facts tha! 
This interpretation derives from the tribute 
(a) the low group is normally teness D% 
around zero, (b) there is a discre oup, # 
tween the low group and the high ms cannot 
(c) the gap between the two group scori”S 
be considered to be an artifact of the” 5 40 
procedure in which the maximum age in. 
is assigned for the remainder of the 272 
after S falls (see Fig. 1). rd way 
The negative scores (greater forwa i mental 
in the control period than in the expe" Neg: 
period) offer another point of interest- ign of 
tive scores are often interpreted as as in 
negativism on the part of S, sometimes 
abnormal or morbid sense (Hull, 1933; 
dis, 1932). There is no r 
suspect such negativism jn 


study, since they all freely yoluntecre 


T. to 
eason, howeve ‘pis 
so many Ss 12 


q for 


sa 


Postural Sway Distribution 


the experi Š 
a o ment Furthermore, the negative and 
ie att scores appear to be on a continuum 

of the same, unresponsive distribution. 


Conclusions 


ee limited by the size of the sample 
the aboy ik replication with diverse samples, 
sway a data indicate: (a) that the postural 
e€ com ribution is not normal and may well 
the con of two separate groups, and (b) 
Person erpretationl of negativistic attitudes or 
Postu alities, made on the basis of negative 
car ral sway scores, must be applied with 

€ and only after additional criteria are met. 
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THE SET TO CLAIM UNDESIRABLE SYMPTOMS 
IN PERSONALITY INVENTORIES 


CLINTON B. DESOTO AND JA 


MES L. KUETHE 


Johns Hopkins University 


The importance of subjects’ (S9) response 
sets in their performance on tests and ques- 
tionnaires has been noted for many years. 
Cronbach (1950) discusses several Tesponse 
sets which depend on the form of test items, 
such as the tendency, varying in degree among 
Ss, to say “true” to items which may be an- 
swered “true” or “false,” or “agree” to ques- 
tions which may be answered “agree” or “dis. 
agree.” This response set is known as the 
acquiescence set, Response sets seem to oper- 
ate whenever items are difficult or ambiguous, 

Most items on Personality inventories ap- 
pear ambiguous enough to arouse the opera- 
tion of response sets, Items such as these 
from the Psychasthenia (Pt) scale of the 
MMPI, for example, fail to give § unam- 


biguous standards for his report of his be- 
havior and experiences: 


My memory seems to be all right. 


I certainly feel useless at times, 
I have strange and peculiar thoughts. 


The phrases “all right,” «“ 


1951). Fricke (1956) 
that in most personality 
keyed in one direction, 
tially susceptible to seri 
response set. 


This article reports an exploration of the 
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f 
r cale 0 
Operation of response sets in the Pé si 


the MMPI. 


Method din 
A balanced Pż scale was construch ly 
Which 24 of the items are keyed hishe 
and 24 negatively. This was accomp are not- 
reversal of 15 of the 39 items which were 1e- 
mally keyed positively. These items ae ap 
Written so that an answer of “true from a 
Proximately the opposite meaning . jn gem 
answer of “true” to the original item; Jaim of 
eral, an answer of “true” becomes a 5 ra 
freedom from an undesirable Sa a 
than a claim of the symptom. The 1 ther with 
items are presented in Table 1, toge 


Reversal of Pt Items _ ae 
MMPI 
Booklet 
Number 
of Original 
Item Reversal E 
ta: 
we i na 
32 I find it easy to keep my mind 0} as 
or job. to P 


em 

- 67 I feel I am as happy as others = 
76 Most of the time I feel happy- 
86 T have enough self-confidence. 


yell as eve™ 
159 T understand what I read as T 
182 I am quite sure of my mental he time. 
189 


I feel pretty energetic most of H 
217 I seldom find myself worrying 
thing. 


bout som! 


266 I seldom become very excited. talk pefor® 
304 In school I found it quite easy to 
the class. 
321 I am seldom embarrassed. 
336 Tam usually patient with people. ay to me: 
342 T usually remember what people say 
356 Ihave good powers of concentration- 
361 


To 
Sooo 


ide- 
I am inclined to take things in my St! | 


The Set to Claim Undesirable Symptoms 


their MMPI booklet numbers. These 15 items, 
together with the 9 negatively keyed items in 
the original Pé scale, constitute the 24 nega- 
tively keyed items in the balanced Pz scale. 
The remaining 24 positively keyed items in 
the original Pż scale were not altered in the 
balanced Pt scale. 

The balanced Pt scale was given in printed 
form to 44 Johns Hopkins University summer 
school students in an introductory psychology 
course. These Ss were of both sexes and varied 
Widely in age and background. / 

The balanced Pf scale was also given in 
printed form to 95 Johns Hopkins winter stu- 
dents. Another 95 winter students took the 
original P# scale in printed form. Like the 
summer school students, the last two groups 
Were students in an introductory psychology 
Course, but they were all males and were 
More homogeneous in age and background 
than the summer school group. 

The “cannot say” response was made un- 
available to the Ss in these forms of the Pf 
Scale, in order to permit fullest operation of 


the acquiescence set. 


Results 


uating acquiescence in a 


O . 
aie oles: n the positively 


Scale is to correlate scores O i 
keyed items with scores on the nesses 
keyed items, Such correlations are re ioa y 
acquiescence, sometimes eyen becoming neg 


i i iti Jated to 
tive, si sascence is positively re 
e, since acquiesce: Sas Dae nee 


Scores on the positively keye 2 
tively ae to scores on the negatively 
keyed items. : 7 
The positively eyed and meena td 
Subscales of the balanced P4 sca 
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.66 for the summer school students and .59 
for the winter school students. Application of 
the Spearman-Brown formula in the manner 
customary for split-half correlations raises 
these figures to .80 and .74, which are scarcely 
lower than reliability coefficients typically re- 
ported for such scales (Edwards, 1957; Hath- 
away & McKinley, 1951). 

The intercorrelations between the oppositely 
keyed halves of the balanced Pt scale are so 
high, in fact, that acquiescence set can be 
ruled out as an important factor in Ss’ per- 
formance on the scale. Ss do not show tend- 
encies to agree or to disagree with these items 
without regard to their content. 

In tests for which acquiescence is an im- 
portant factor, it has been found that Ss show 
fairly high average acquiescence, despite large 
individual differences (Cronbach, 1950). Thus, 
another possible manifestation of acquiescence 
sets is a higher average score for items when 
they are positively keyed than when they are 
reversed and negatively keyed. Table 2 shows 
that the 95 Ss who took the original P# scale 
obtained a mean score of 3.57 on the 15 items 
which were reversed on the balanced P¢ scale. 
The 95 Ss who took the balanced scale ob- 
tained a mean score of 4.42 on these items as 
reversed. The difference between these means 
is significant at the .05 level by £ test. Scores 
averaged lower on the positively keyed items 
than on the negatively keyed reversals. This 
result is the opposite from that which ac- 
quiescence would have caused. It is further 
evidence against the operation of acquiscence 
in Ss’ performance on these scales. 

Other comparisons of the performance of Ss 
on subscales of the original and balanced Pt 


Table 2 


andard Deviations of Sc 


ores on Subscales of the Original and Balanced Pt Scales 


Means and St 


Original Scale Balanced Scale 


yi both scales 
24 items positively keyed on bo 


h scales 
Oätems negatively keyed on both 
i veyed on original scale, but 
15 items positively ay keyed on balanced scale 
‘ a 


M 507 M 


5.59 

SD 3.61 SD 359 
W 2.82 M 297 
SD 1.71 SD 1.56 
af BST. M 4.42 
SD 253 SD 2.70 


reversed and nes 
Ne 


498 


scales, as shown in Table 2, reveal no signifi- 
cant differences. The distributions of scores as 
summarized by means and standard deviations 
are similar for corresponding subscales of the 
two scales. Even the one significant difference 
is actually rather small. It appears a reason- 
able conclusion that balancing the Pé scales 
did not appreciably influence Ss’ scores, either 
on the actually reversed items or, through 
context, on the unaltered items, 


Discussion 


It was remarked earlier that Most items on 
the Pé scale are ambiguous enough that re- 
sponse sets would be expected to Operate in 
Ss’ answers to them. Yet the results show 
that the acquiescence set, ordinarily a power- 
ful factor when ambiguous true-false items 
are given, is essentially absent as a factor in 
the Pt scale. The Ss failed to take the usual 
advantage of the items? ambiguities, so to 
speak. Why? 

There is eviden 
Ss, at least) quickly notice that items like 
those on the Pt scale are concerned with per- 

es, with symptoms, 

Wiener (1948) found that the Pt scale is 
composed almost entirely of “obvious” items 
—“those to which significant responses were 
relatively easy to detect as indicating emo- 
tional disturbance” (p. 165). De Soto, Kuethe, 
found that Ss agree well 


Se set, even though it 


tent dealing with sym 
biguities in the items 
fake (Meehl & Hathaw. 


lationship to actual symptoms tenuous. 


The symptom-claiming set seems to be pre- 


Clinton B. DeSoto and James L. Kuethe 


potent among response sets. It seems to bet 
major factor in the Pf scale and other E 
with many “obvious” items, renia A 
validity as measures of other traits ene. A 
ducing correlations between scales inten a Pt 
measure separate traits. For example, ee 
scale correlates .84 with the Sc scale ( A 
away & McKinley, 1951), it correlates ma 
with the Taylor Scale of Manifest an 
(Eriksen & Davids, 1955), and it eor 
—.84 with Edwards’ Social Desirability ales 
(SDS) (Edwards, 1957). These a aie 
tions approximate the reliability poe yards, 
typically obtained for such scales (Edy dicat- 
1957; Hathaway & McKinley, 1951) in same 
ing that the scales measure largely the 
thing. m- 
Those who have recognized a sy 
claiming set have tended to treat it as 4 
sponse sets are usually treated, that a 
Nuisance to be eliminated or controle res ol 
K scale was developed to correct ere re- 
MMPI clinical scales for essentially Hae the 
SPonse set, and its authors remark t ehl & 
Pt scale could be similarly used yer the 
Hathaway, 1946). Edwards suggests E scale 
Scale might serve better than the nd he 
to correct the MMPI clinical scales, a raoi 
further has developed a forced-choice i jon 
ality test designed to prevent the op 
of the response set (Edwards, 1957). wevel 
ere are reasons for believing, ai de- 
that this symptom-claiming set is ME pall 
serving of continued study as a persi 
variable in its own right. sandi 
Its prepotency over the otherwise ip appe? 
response set of acquiescence makes it 4 
important. ity 
Tt seems to be the easiest of all personals 
variables to measure well with ae a 
items. This may be due to its prepa r 
a response set, but in any case it argk ologi 
ther for its importance in people’s re e 
cal functioning. The correlations betwee a 
Pt scale and the Sc, Manifest Anxiety; ip 
SDS mentioned earlier are extremely ne 
comparison with most correlations bet in 
measures of personality variables, and the = 
tercorrelations of the last three scales Ed- 
equally high (Brackbill & Little, 1954; i 
wards, 1957). These four scales were oo 
structed independently to measure differe” 


erful 


The Set to Claim Undesirable Symptoms 


| Personality variables (although their items 
were drawn from the same large MMPI pool), 
yet they turned out to be essentially meas- 
ures of the same variable, the symptom-claim- 
ing set. The resistance of the Pf scale to ef- 
fects from the reversal of its items in the 
Present study also attests to the relative ease 
of good measurement of this response set. 
Despite the evident importance of the symp- 
tom-claiming set, however, its function in per- 
Sonality is far from well understood. 
The SDS, Pf, Sc, and Manifest Anxiety 
Scales, which appear to measure primarily 
'S response set, have been correlated with 
Many other behavioral measures, and some of 
ese correlations may be useful in under- 
anding the response set. Eriksen and Davids 
1955) report clinical ratings by H. A. Mur- 
"ay of 20 Ss on the trait of “optimism-pes- 
‘imism,” based on interviews of the Ss and 
their autobiographies, which showed a rank- 
a, Order correlation of —.90 with the Pt scale 
| ‘nd —.87 with the Manifest Anxiety scale. 
Unto 


St 


Ttunately, however, most correlations be- 
Ween these scales and other behavioral meas- 
nres have been much lower than this. Some of 
ese low correlations may be attributable to 
nique factors on which these scales seem to 
( mada differential light loadings (Hathaway & 
McKinley, 1951; Taylor, 1956). 
lt is probable, however, that the symptom- 
‘timing set itself is determined by more than 
Sue Psychological factor, each of which may 
àccount for some of the diverse correlates o 
k response set. There is convincing evidence 
at scores on these scales depend heavily ~ 
Tonic anxiety or emotional gong oe 
(Taylor, 1956), on tendency to use or & 
ense mechanism of repression (Eri oes 
Davids, 1955; Eriksen, Kuethe, & Su at 
58), and on effort to make a good rA 
don on others (Edwards, 1957; De 
t al, 1959), 
Tf these or another $ 
Sonality factors jointly 
reo Symptom-claiming Set Ailes. it appears 
lations with other var ered. 
ik nly be uncovered by 
cy that they can Pti nships among sev- 
Studies of the joint relatio: 
H tal selected persona 
ii avioral measures, 45 
*trelations betwee? 


et of underlying per- 
determine scores on 
et and hence its cor- 


lity scales and other be- 
opposed to the pair-wise 
measures which have 
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typified past research involving the response 
set. P 

This is not to say, however, that ordinary 
factor analysis is necessarily appropriate to 
the problem. 

Suppose, for example, that the response set 
(x) is a function of two factors, actual degree 
of anxiety (y) and degree of anxiety which 
the person can express (2). And suppose that 
an individual's score on the response set 
equals the Zower of his scores on the two fac- 
tors, that is, 


x = the lower of y and Z. 


If an individual's actual degree of anxiety is 
lower than the degree of anxiety which he can 
express, as limited perhaps by repression and 
suppression, he will express his actual degree 
of anxiety, by claiming symptoms, and no 
more. On the other hand, if the degree of 
anxiety which he can express is lower than 
his actual anxiety, he will only reveal the ex- 
pressible degree, no matter how much lower 
this is than his actual anxiety. 

At least two of the implications of such a 
model receive empirical support. This model 
implies that, if the distribution of scores on 
the factors is symmetric, the distribution of 
scores on the symptom-claiming response set 
will be skewed upward, and this is the case 
for all of the scales which are good measures 
of the response set (Edwards, 1957; Hath- 
away & McKinley, 1951). 

The model also implies that people scoring 
low on the symptom-claiming set are more 
heterogeneous with respect to both factors 
than people scoring high on the response set, 
a as by being high on bot 
deed been Sind kine apie | DANE ins 
high scorers on a fart ihian 

st _ other behavioral measures 
ip may be influenced by these factors, 
ino Gage determinants of their be 

n et al., 1958) and paired-as- 


sociates learning 
1956). arning (Spence, Farber, & McFann, 


In contrast to 


factor-analytic for 
form 


the above formulation, a 
mulation would be of the 


x= ay + bz 


and would be clearly inappropriate. 
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If it is the factor on which a person has the 
lowest score that determines his symptom- 
claiming set, then the scales which are excel- 
lent measures of the response set are actually 
excellent measures of this factor. The prob- 
lem will be to determine which factor is the 
one being measured for a given individual, 
and this can very likely be accomplished. 


Summary 


This article reports a study of response sets 
in the Pé scale. It was pointed out that most 
items in the Pé scale and similar personality 
scales are ambiguous enough to arouse the 
operation of response sets, in particular the 
acquiescence set, since the items are of a 
true-false form. 

A balanced P¢ scale was constructed by re- 
versal of 15 positively keyed items to make 
a total of 24 Positively keyed and 24 nega- 
tively keyed items, High positive correlations 
were obtained between the positively keyed 
and negatively keyed subscales, Reversal of 
the 15 positively keyed items to make them 
negatively keyed did not lower Ss’ mean score 
on them. These results indicate that acquies- 
cence is not important in the Pt scale. 

Instead, the Pt scale measures a prepotent 
Tesponse set: tendency to claim symptoms, 
which varies widely in degree among Ss. This 
Symptom-claiming set is tapped or activated 
by items with content dealing with symptoms. 


The Pt scale and other scales with which it 
correlates highly seem to be excellent meas- 
ures of this response set. 

The diverse correlates of these scales indi- 


cate that the Symptom-claiming set js deter- 


Clinton B. DeSoto and James L. Kuethe 


ibl, 
mined by more than one factor, but pee 
in such a manner as to make factor ni 
an inappropriate technique for their study- 
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EFFECT OF A TRAINING SCHOOL EXPERIENCE 


ON THE PERSONALITY OF DELINQUENT 
BOYS* 


SYLVAN B. CADITZ* 
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Renn? 
chiga training schools for delinquent 
test ren—has yet to be put sufficiently to the 
Exist of objective evaluation. These schools 
l Ra great part to promote salutary changes 
ly antl whose behavior, and presum- 
cian crying personality, are more or less 
I 


on. Y unacceptable and require modifica- 


s 
t 
tial. 1s important to understand the essen- 
ad personality differences between delinquent 
l 


l 
toa ents and the normal adolescent popu- 
ate g in order to be better able to evalu- 
he character and direction of expected 
Der to be effected by the training school 
ee Early representative studies of de- 
Ce utilizing the MMPI, are those by 
lin ell (1945), who demonstrated that de- 
$ Quent girls were more maladjusted on all 
nonde eight MMPI clinical scales than were 
Who Clinquents, and by Monachesi (1953), 
anq found differences on all scales except Hs 
qu f between his various groups of delin- 
boys and two control groups. A broad 


te, 
Search program was reported by Hathaway 


a . 

pra q TOMachesi (1953), in which 4048 finih 
M € Pupils in Minneapolis were given the 
Tee Two years later, the records were 
ulea on those who had come to the atten- 


sion of the authorities as a result of delin- 
ment behavior. Findings revealed significant 
PI differences between the eee aa 
00 subsequently nondelinquent eae 

ol records on many scales with Pa, Sc, 


et Condensed from a doctoral dienian ieee 
. one under the 
di the University of Washington an 


recti ther. 
action of Charles R. Stro uvenile Court, Seattle, 


abi 
X| 


chan, 
Rene 


E. 
treat © of the most extensive programs of 
oye ent and rehabilitation functioning in 
| 

R l 


u 
n i 
i 
a 
i 


Conty 


as OW at the King County J 
ington. 
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Ma, and especially Scale Pd, positively asso- 
ciated with delinquent tendencies. 

The only research data found which ap- 
pear to bear directly on the effects of a train- 
ing school experience as evaluated by objec- 
tive psychological tests was Capwell’s 1945 
study of delinquent girls. She repeated, 4 to 
15 months later, a battery of objective-type 
personality tests, including the MMPI, ad- 
ministered to 101 girls at a state training 
school and 85 nondelinquent high schools 
girls. The results suggest the delinquent 
group in many respects become more “nor- 
mal” during their incarceration. 

The present study is concerned with the 
differences in personality traits, as measured 
by objective tests, between delinquent and 
nondelinquent adolescent boys. The primary 
problem to be investigated is whether, as a 
result of a training school experience, the de- 
linquents become more like the nondelinquent 
population. 

Method 
Subjects 


Delinquent group. The delinquent 
row 

was drawn from 195 boys judged cree 
by the juvenile courts and transferred to the 
State Reception-Diagnostic Center at Che- 
halis, Washington. The 195 boys were all the 
feo and tested at the Reception 

stic Center over a i 3 

period of 
T except for four cases of es 
aid pa bag ied during a three-week 
esting w. i i 

{BS depletion. at a y Nl due to 


Ninety- i 1 
aeitiiy PAS of this group were subse- 
Oe kn nsterred to institutions other than 
be te g school (a state operated school 
nger, more immature boys, or a for- 
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estry camp) or were paroled directly to the 
community. The effect of this procedure is 
clearly to assign to the training school, from 
the incoming delinquent group, the older, 
more hardened delinquent offenders and indi- 
viduals most in need of external sources of 
control. 

Of the 104 boys transferred to the training 
school, three were released earlier than the 
two-month minimum stay required for inclu- 
sion in this study (usually the result of cir- 
cumstances external to the boy’s adjustment, 
i.e., family leaving the state), five left under 
emergency conditions and could not be re- 
tested, and two arbitrarily refused to cooper- 
ate for the second testing. The 94 remaining 
boys who constitute the experimental group 
averaged 15.6 years old (range 14.1 to 17.7) 
and were retested after an average lapse of 
five months, 27 days (range 2 months, 16 
days to 10 months, 23 days) of residence in 
the training school, Only four of these boys 


were at the training school less than four 
months, 


Nondelinquent grou 


p. All boys from the 
sophomore classes of 


two high schools that 
f testing comprised the 
One of the schools, lo- 
cated on the fringe of a large metropolitan 
on), provided 48 
6 months, 13 days 
ol, which serves the 


ence Scale (EPPS). Di diagnostic 
studies involving the MMPI are pr 

the literature and ther 
number of cases where it has 

evaluate therapeutic changes in 
of populations (Gallagher, 1953; 
1953; & Scofield, 1953). 


been used to 
Various types 
Onachesi, 
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Í 
As an additional, independent meas 
personality, the EPPS was selected. A Ei 
article by Merrill and Heathers (1956) Tae 
up the complementary relationship truce 
the MMPI, which evaluates personality status 
ture, and the EPPS, which reflects the norms 
of the motivational systems. Extensive Jation 
for the EPPS on an adolescent popu“ 
have been provided by Klett (1957). modifi- 
Administration. The following wa tration 
cations of traditional MMPI eS y: 
procedure were made for all Ss of this ; 


: ing we! 
First, all groups at the time of testing 


: ” to al 
instructed to answer “true” or R cal” 
the items utilized, thus eliminating egory: 


not say” (?) variable as a scoring cata ha 
This was done because prior apenre delin- 
indicated that a sizable proportion © inordi 
quent boys invalidate their tests er than 
nately high “cannot say” scores. Bati scores 
lose cases by overly high “cannot say t-taking 
it was felt better to evaluate poor a scales: 
attitudes through the other Lense was 
A second modification in the proce test í 
the use of the shortened form of wea 66 
Suggested by Cottle (1953). The juded #* 
items plus seven additional items oe or sc 
the K scale were answered, allowing xceptio” 
ing of all original scales with the © i 
of Si, lowe 
The administration of the EPPS a with 
that of the MMPI for all groups tes the game 
the instructions remaining essentially 
as printed on the test booklet. - the pu 
Scoring. It was felt important for prac jce 
pose of this study to re-evaluate the record’ 
of eliminating from the data mer score® 
with higher than usual L, F, and_ ited i 
As this study was primarily orie aria Jes: 
ward changes in personality test Vi 1 jndi 
it seemed vital that the scores of ‘ae est 
viduals capable of complying with resent?” 
directions be included to insure a a recor? 
tive sample. The rejection of MMP. res as 
with unusually high L, F, or K er ror 
commonly practiced) would elimina) ad sig 
the experimental group a distinctive s po u 
nificant segment of the training schoo paw’ 
lation. In their prediction study, Hat % 
and Monachesi (1953) found that 317p 
boys having invalid MMPI records 5 q 1 
quently became delinquent as compare 


es Ó ee a 
=, > = —_ ll" ~- 
Sy a —e a 
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E of boys having valid records. They 
of the E- - a priori it would seem that one 
validity important factors making for in- 
related nee the records from boys is also 
acts? (p a e commission of the delinquent 
found in th 1). To exclude significant changes 
. ese “ invalid” records upon retest- 


mg from thi z 
be justified. is body of data could not easily 


Background Variables 


pees of earlier studies in this area 
aPpear a two background variables that 
Uents: ciated to the test scores of delin- 
an int of intactness of the family 
Belmont history. Each member of the 
areas fy nt group was rated in each of the two 
cludi Y examination of official records, in- 
ng the case history. 

consider aniy background in each case was 
Were Ji ed unbroken if the natural parents 
Ment iving together at the time of commit- 
Sine there were no previous extensive 
Cases ions. Only 30 of the 94 delinquent 
omes or 33%, were products of unbroken 
the de, The remaining background variable, 
gree of antisocial behavior, was evalu- 
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Level I—Estensive delinquency: serious offenses 
committed over a period of time and indicated by 
olvement in more than three larcenies, burglaries, 
or personal assaults as reported in the case records. 

Level II—Moderate delinquency: indicated by 
serious offenses of limited frequency or minor of- 
fenses. This group includes all boys not in Level I. 
These are boys with three or less serious offenses 
or involvement in such acts as runaway, window 
breaking, sexual exposure, fire-setting, etc. 


inv: 


Final tabulation revealed that 28, or about 
30%, of the total cases were rated as Level I 
or having a history involving extensive, act- 
ing-out behavior, while the others, 66 in all, 
fell into the more moderate delinquency cate- 
gory. 


Treatment of Data 


The experimental hypothesis of greater 
similarity between the delinquent and non- 
delinquent boys following the training school 
experience was evaluated by comparing their 
test results at the first testing and again at 
the second testing. In order to better evaluate 
each group’s contribution to the obtained dif- 
ference values, a comparison was then made 
of the results of the first testing with that of 
the second for each of the groups. 


ate 
in terms of two levels: The role of each of the background va- 
Table 1 
MMPI M , x n | Deviations of the Delinquent Boys Contrasted with Nondeli 
= ene SHE at the Time of the First and Second Testings ehaghent Boys 
Se S pe == — — 
First Testing Seoni hetine = 
Del. Nondel. _ Nondel. 
Cale = am Try sp Män. RE 
~ M SD a M SD Haak 
L —_— — 5 ; 
r 4 3.80 2.67 34 = 
k aaa os 872 692 142 3.68 2.44 34 
È 1448 467 13.60 4.53 -88 7.10 6.26 EOS 
a 1413 423 13.75 481 38 14.93 4.46 ‘98 
ee a ai 13.14 4.26 08 
Hy pr go Bana Ia 17.84 4.78 113 
sf zoso Sg ne i aem 19.86 454 -13 
My ae 22.55 4.27 276 a 5 i4 
21.79 4.60 2 22.56 4.94 2k 
Pa 1318 501 10.35 3.63 2.83** 2252 4.50 6.18 
Pi = "36 29.05 6.39 1.21 0 n = 91 
Se 30.26 Ot 31.60 9.78 12 9.97 3.44 i644 
M 32.85 8.07 21.65 4.73 rae 28.25 5.65 —46 
a 23.30 497 : . 65" 30.65 Bis K 
z i ; 85 3.96 “Og 
in wnich the delingen fppun is lower than the nondetin — 


^ A difference 
à beyon 
ee! Siaran at or Peyond the .01 level of confidence, 


que: is i; 
nt group is indicated by a minus 
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riables, intactness of the family and extent 
of delinquent history, was evaluated by inde- 
pendently comparing each of the alternatives 
within each variable with the nondelinquent 
group at both the first and second testings. 


Results 
Difference Between Groups 


Table 1 compares MMPI scores for the 
delinquent and nondelinquent groups at the 
time of the first testing and again at the 
second testing. Statistically significant differ- 
ences on the Pd and Pa scales at the -01 level 
of confidence and Ma scale at the -05 level at 
the first testing are in accord with previous 
studies of comparable delinquent and non- 
delinquent populations. The profile of MMPI 
differences approximately duplicates Mona- 
chesi’s (1953) data comparing a training 
school group with nondelinquents, except that 
the present study shows a Statistically signifi- 
cant difference for the Ma scale whereas 
Monachesi’s Ma difference fell somewhat 
short of significance, 

Following an average trainin 
of approximately six months 
quents and a com 
the high school g 


g school stay 
for the delin- 
parable interim period for 
roup, the proñle of differ- 
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Table 2 


rd 
Statistically Significant EPPS Means and Se 
Deviations of the Delinquent Boys Contras 
with the Nondelinquent Boys at the Time 
of the First and Second Testings 


Non- 
Delinquents delinquents 
lifi. 
Scale Mw sp MSD Mea 

Ist Testing -152 
Change 14.48 3.53 16.00 3.45 "ioe 
Consistency 8.66 2.87 9.45 2.48 
2nd Testing— 
None 


han 

is lower t 

* A difference in which the delinquent group ie 

the nondelinquent group is indicated by a minu fidence. 
ignificant at or beyond the .05 level of Sonfidence- 
ignificant at or beyond the .01 level of cor 


at 

ences remains similar to the one found 
the first testing. It is interesting to oe 
ever, that the difference value on the P 
is larger than found at the first testine ah 
the difference values on the Pa and ie tic 
are lower but nevertheless remain statis 
significant. the two 

Table 2 contrasts EPPS scores of 6 EP 5 
Sroups. At the first testing, of the 1 showed 
scales, only change and consistency 


owe 
scale 
whi 

ales 
ally 


Table 3 


MMPI Means and Standard Deviations of t 
for the Delinquen 


in, 
he First Testing Contrasted with the Second Testing 
t and Nondelinquent Boys 


Delinquents 


Ist Testing 2nd Testing 


Nondelinquents 


Ist Testing 2nd Testing if 
ae eee sage ; ye dill: 
Scale M sp M SD Mät. M SD M SD F 
d E 
5 414 2.40 4.02 2.59 12 3.80 2.67 3.68 2.44 1.02%, 
F 10.14 6.89 8.15 5.55 1.99** 8.72 6.92 7.10 6.26 133 
K 14.48 4.67 15.86 5.33  —138* 13.60 4.53 14.93 4.46 Ol, 
Hs 14.13 4.23 13.22 3.88 .91* 13.75 4.81 13.14 4.26 1.52 
D 20.57 4.44 18.97 435 1.60** 19.36 5.18 17.84 4.78 SA 
Hy 20.60 4.40 20.00 4.24 .60 19.44 5.05 19.86 4.54 1.28 
Pd 29.45 5.80 28.74 4.07 71 23.84 5.35 22.56 4.94 03 
Mf 21.79 4.60 21.61 4.29 AS 22.55 4.27 22.52 4.50 38 
Pa 13.18 5.01 11.61 3.32 1.57** 10.35 3.63 9.97 3.44 80 
Pi 30.26 6.36 27.79 5.30 2.47** 29.05 6.39 28.25 5.65 95 
‘Sc 32.85 8.47 31.18 8.26 1.67 31.60 9.78 30.65 8.69 80 
Ma 23.30 4.97 22.13 448 117* 21.65 4.73 20.85 3.96 
* A difference in which the seco; 


* Significant at or beyond the al 
** Significant at or beyond the ‚01 level of confidence, 


Oe testing mean is higher than the first testing mean is indicated by a minus. 
05 level of confidence. 


a Arse testing (but 
| 


Personality oj Delinquents after Training School 


Significant differences between the training 
School and high school boys. At the second 
testing there are no significant differences on 
any of the 16 EPPS variables. 


Test-Retest Differences within Groups 


Am evaluation of the relationship between 
in ipa and direction of changes occurring 
tin Sroup’s test performance at the second 
su os as compared with the first and the 
com quent effects upon the between group 
o parisons appears worth-while. In the case 
c A ariables which showed no significant 

ae of differences, the mean scores may 

May Sapien essentially static or else there 
Score: ave been parallel changes in the mean 
When of both groups. On the other hand, 
Were ro Snificant changes in difference scores 
ential ound, there may have occurred differ- 

al changes in either one of the two groups. 
he MMPI . Table 3 presents a compari- 
of MMPI scores for the two testings. 
of a are statistically significant reductions 
aa scores for the delinquent boys on 

f S F, Hs, D, Pa, Pt, and Ma and increase 
a he impression is unmistakably of 
So “ment in the direction of lessened per- 

nality disturbance and greater maturity. 
the similar comparison of MMPI scores for 
ed Nondelinquent group shows a significant 
P uction of mean scores on the F, D, and 
Val Scales and an increase of the K i 
th ue. As in the case of the delinquent boys, 

Ne impression is also of movement in the 
direction of personality stability and inte- 
Station, 

EPPS. Table 4 presents a comparison of 
EPPS data from the first and second testings. 

he affiliation scores decreased significantly 

(at the .01 level of confidence) and the ee 
8ression scores increased significantly (at the 
YS level of confidence) in the case of the de- 
Mquent group. 
similar comparison 


Son 


cant change occurring as an increase of 


© autonomy scores (significant at the .01 


ey, e). A EAR 
The : iy aia showing significant be- 
a only 'ifferences at the time of the 
-group not at the second testing), 


hange and consistency nevertheless do not 


QUO 


Table 4 


Statistically Significant EPPS Means and Standard 
Deviations of the First Testing Contrasted with 
the Second Testing for the Delinquent 
and Nondelinquent Boys 


ist Testing 2nd Testing 
Scale M SD M SD Medii. 
Delinquents Aa i: 
Affiliation 15.84 3.73 14.72 3.42 L 
Aggression 12.07 4.10 12 3.70 -! 
Nondelinquents ae 
Autonomy 12.76 3.34 14.05 3.87 —1.29** 


a A difference in which the second testing mean is higher than 
the first testing mean is indicated by a minus. 

* Significant at or beyond the .05 level of confidence. 

** Significant at or beyond the .01 level of confidence. 


demonstrate significant changes within each 
group. 


Family Intactness 


Tables 5 and 6 present a comparison of 
MMPI data of the nondelinquent group with 
each of the two portions of the delinquent 
group divided on the basis of the intactness 
of the family. 

First testing. Table 5 presents the MMPI 
scale comparison of the two delinquent groups 
with the nondelinquent group for the first 
testing. In addition to the Pd, Pa, and Ma 
scales, which are found to be significantly 
different for the total group (see Table I); 
the broken home boys also produced signifi- 
cant difference on the K and Hy scales 
whereas there is a decidedly reduced Pd dif- 
ference and nonsignificant Ma difference when 
the unbroken home boys are compared with 
the high school boys. These results strongly 


roportion of the 


from broken homes, 
Second testing, A co; 
ults of delinquent: 


900 
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Table 5 


MMPI Raw Means for Delinquent Bo: 


ys of Two Family Backgrounds Contrasted with the 
Nondelinquent Boys at the Time of First Testing 


Broken Unbroken 

Home Home 
Scale (N = 64) (W = 30) 
£ 4.33 3.73 
F 10.58 9.20 8.72 
K 15.42 12.47 13.60 1.82* 
Hs 14.67 12.97 13.75 92 
D 20.83 20.03 19.36 
Hy 21.17 19.37 i 
Pd 30.70 26.77 23.84 6.83** 
Mf 21.72 21.93 5 
Pa 13.38 12.77 10.35 3.03** 
Pt 30.91 28.87 29.05 1.86 
Sc 33.61 31.23 j 
Ma 23.88 22.07 21.65 


R 


+ — 07 
3.80 33 
1.86 A 


| 
£ 
Nondelinquent a 
(N = 97) D'y_sp Dus- 
| 


a A difference in which the delinquent subgroup mi 


= ainus. 
i is indicated by a ™ 
ean is lower than the nondelinquent group mean is indicated 
2 Significant at or beyond the .08 level of soupa Can i 


** Significant at or beyond the <01 level of confidence, 
crease in mean differences of 
groups on the Pd scale at r 
largely the result 
scale by the unbr 


the two main 


etesting seems 
of increased scores on this 


oken family group of boys. 
Seriousness of Delinquency Variable 


Tables 7 and 8 Present the test data of 
the training school group divided into two 
Parts on the basis of seriousness of history 
of antisocial behavior, again with the expec- 


q 


uent Boys of Two Family Backgrounds Contrasted with the 
Nondelinquent B 


in theif 
tation that there will be a difference ious 0. 
movement toward normalcy. The S fender 
fenders (Type I) and moderate © 


; ently 
(Type II) are each compared independ 


First testing, A comparison of the M 
7. 
nondelinquents is presented by Table h 


ic 
sentially similar profiles are found ite 
in accord with the total group di 


N 
th 
è o 
scores of each offense type with those E 
a 
ns 


f- 
5 
: ts. 
with the high school group for both tes MP! 
z 
re 
S 


ent Boys at the Time of Second Testing pee 
Broken Unbroken 
Home Home Nondelinquent ; 
Scale (N = 64) (N =30) (N = 97) Decay Dup-nP_ 
L 4.19 3.67 3.68 St = 
7 wn 6.73 7.10 1.71 37 
6. 15.30 14.93 1.20 i 
Us 13.64 12.33 13.14 50 E 
D 19.20 18.47 17.84 1.36 f 
Hy 20.61 18.70 19.86 15 =a 
Pd 29,42 27.30 22.56 6.86** 4.74 
MJ 21.42 22.00 22.32 -1.10 = 
Pa 11.75 11.30 9.97 1.78** 1.33 
PI 28.11 27.10 28.25 =i =1.45 
Sc} 31.47 30.57 30.65 82 —.08 
Ma 22.11 22.17 20.85 1.26 1.32 } 
~~ Bika A 


** Significant at or beyond 


delinquent subgroup mean is lower than the nondelinquent 8roup mean is indicati 
the .01 level of confidence. 


eqs? 
d py a mine 
e 


Personality of Delinquents after Training School 


Table 7 


MMPI Raw Means for Delinquent Boys of Two Offense Types Contrasted with the 
Nondelinquent Boys at the Time of First Testing 


Otfense Offense 

i Type I Type II Nondelinquent 

Scale (N = 28) (N = 66) (V = 97) D'-xp Du-xp 
2 414 414 3.80 34 34 

"9 9.20 10.50 8.72 1.78 

K 1414 14.62 13.60 54 1.02 
Hs 14.57 13.94 13.75 82 19 

p 21.43 20.21 19.36 207 85 
Hy 20.29 20.73 35 129 
Pd 30.32 20.08 6.48** 3.24** 
Mf 21.46 21.92 —1.09 —.63 
Pa 12.68 13.39 2.33** 3.04** 
et 30.00 30.36 05 131 
Se 32.29 33.09 69 149 
Ma 21.89 23.89 24 2.24** 

ieee a 
Pay difference in which the delinquent subgroup mean is lower than the nondelinquent group mean is indicated by a minus. 


Significant at or beyond the .01 level of confidence. 


mt able 1), except that only the moderate 
delin er is significantly different from the non- 
quent on the Ma scale. 
the oenn testing. The MMPI differences for 
delin delinquency level groups and the non- 
Tae s at the second testing are given in 
‘em, © 8. In general, the pattern of differences 
ans similar to those of the first testing. 
fend Pa and Ma scores of the moderate of- 
sig S have decreased somewhat but remain 
8Nificantly different from the high school 


boys, while the significant Pd mean differ- 
ence has further increased. In the case of the 
more serious offenders, their mean Pa score 
has decreased although still significantly dif- 
ferent than that of the nondelinquents, while 
their stay at the training school involved an 
increase in difference of Pd and D scores. 


Discussion 


The results of this study confirm the pres- 
ence of important differences between the 


Table 8 
as for Delinquent Boys of Two Ofiense Types Contrasted with the 


MMPI Raw e adiaqueat Boys at the Time of Second Testing 


N 
<= me Offense j 
n Type II Nondelinquent 
y BES N = 97 (eee 
~ Sale (N = 28) alist __ Aa DAsxn Din 
a 3.68 86 i 
L 4.54 f =; 
r 7.50 Be ba a 132 
K 16.64 15.53 1314 na 0 
Hs 13.89 1842 1784 he ~.20 
D 20.25 Aes i 2.41* 58 
Hy 20.25 28.353 2236 rm 03 
3 9,25 as OO k: = 
Pa es 21.32 22.52 a 5.97" 
Mf eek 11.64 9.97 ae =1.20 
Pa 139 27.58 28.25 ter 1.67** 
Pt 30.89 31.30 30.65 Ea —-67 
Sc ; 22.38 rae 24 65 
Se 21.54 20.85 65 
09 1.53* 


^ A difference i 
ay Significant at Or 
* Significant at oF 


leli 
n which thg the 


beyond the 


inquent subgroup mean 


is low 
105 level of confidence.» OCT than the nondelinque 


“01 level of confidence, Nt group mean is indicated by a minus 
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personality structures of delinquent and non- 
delinquent boys as reported by earlier studies. 
However, evidence for modification of these 
differences in the direction of normalcy by 
the delinquent group as the result of a train- 
ing school experience is limited. The net im- 
pression derived from the analysis of MMPI 
data is that, although the delinquent group 
made notable improvements in many areas 
of personality functioning during their insti- 
tutional experience and remained essentially 
unchanged in others, the nondelinquent group 
made similar changes. 

Perhaps the outstanding feature of the 
EPPS comparisons between the two groups 
is the failure to find both pre-and post dif- 
ferences on the great majority o 
many, if not all, which appea 
popular notions of characteristi 
delinquent activity. This instru 
ready detected considerable d 
tween college and high school st 
1957) and males and femal 
1954). The conclusion that 
therefore, is that the deling 
delinquent boys of this stud 
essentially similar in terms o. 
basic psychological needs as 
EPPS. Evidently, it is prima: 
of expression of their needs 
The implication of this hy 
example, that to some exten 
gressive motive may be expr 
havior of the bo 


f the scales, 
r related to 
c aspects of 
ment has al- 
ifferences þe- 
udents (Klett, 
es (Edwards, 
Presents itself, 
uent and non- 
y are, in fact, 
f most of their 
measured by the 
rily in the mode 
that they differ. 
pothesis is, for 
t, a similar ag- 
essed in the be- 


had no significant eff, 
parisons among the groups. Never- 
€ effects of this modi- 
fication upon the individual Scales is not 
known. This is especially true Considering that 


the procedure of forcing answers to the test 
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items for all subjects may have infil a 
validity, and possibly other, scales i 
What would be ordinarily found for matic 
Populations. The possibility of sy ei: 
effects of the somewhat atypical test a¢ e 
tration procedures as used here rais 
height of the entire profile cannot ay when 
out, and caution should be exercise espe 
comparing these data to other findings, 
cially for diagnostic purposes. « gistinctio® 
The tendency of the K scale, in dis secon 
to the other scales, to be higher at the 
testing suggests the delinquent group ulation 
more similar to the normal college pop — pos 
and less similar to the adult populat or nges 
sibly on the basis of developmental e 
(McKinley, Hathaway, & Meehl, me the 
It is perhaps interesting to note if 


cif 
Pd scale of the MMPI was developed $P 
cally as a measure of tendencies towa" fcr 
Social, acting-out behavior (Hathaway of the 
Kinley, 1951), and more than ais and 
other scales has proved both ees i 
reliable in detecting differences betra sued 
linquents and nondelinquents. In prie 6 
the unbroken family group of de on eli” 
increased their differences with the ie ting Oe 
quents between the first and second be g 
this scale to the extent that the sid be 
with which the null hypothesis cou the a 
jected was raised from the .05 is grou 
level. It appears that, in a sense, ae at the 
did not learn to be nondelinquent we aysal 
training school; rather, there was wwities ee 
zation of the very antisocial přoclivi ing © 
were no doubt instrumental in vee 
training school commitment. If resi foun iy 
modification of antisocial bag: sou re ted 
delinquents from unbroken homes Fa ident 
to the presence of relatively more fir f soci? 
fications with the family and oe acl 
groups, the training school experience, ficatiO 
to weaken essentially positive identi tiso jal 
or else fail to weaken negative, 27 
identifications. the poy? 
In general, of the delinquents, ared t0 
from broken family backgrounds anor ee of 
gain most from the stable, routine pa mpe” 
living which may have operated to COPE, p- 
sate for deprivations that were no oO a i 
portant antecedents to their maladjus jnin 
Thus, there is a tendency for the tra 


f 


SS eee SESS 
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school to stabilize and strengthen the person- 
ality organization of delinquents; at the same 
time, however, to have little effect upon, and 
Possibly hinder in some cases, the assumption 
of socially responsible conduct that is ex- 
pected of members of our society. 


Summary 


Ninety-four boys committed to a state 
training school took the MMPI and the 

PS prior to entry and again after an aver- 
4ge institutional experience of approximately 
SX months. A group of 97 unselected high 
i sophomore boys took the same tests 
ae retested approximately six months 
ae results of the first testing for the de- 
eat and nondelinquent groups were com- 
ae for significant differences on 12 MMPI 
Cales and 16 EPPS scales, and the second 
a results for the two groups were similarly 
“Mpared. The differences between the first 
Second test results for each group were 
Compared, Finally, each of the subgroups 

the delinquents, based on broken or un- 
token family background and severe or mod- 
Tate delinquent history, was independently 
eta with the nondelinquents on the 


also 


e 


The findings indicate: 


1. The traini ¿perience was not 
aining school expetle ; 
“lective in modifying the significant differ- 
“ces between the delinquents taken =a 
koup and nondelinquents which were onn 
ote the delinquents entered the training 
ool, 

f , ; 
ae Delinquents and nondelinquents a et 
he in their basic personality nee 

®asured by the EPPS. f 
t Š. Both one showed improvement rR 
ĉtms of lower MMPI mean scores W a a 
“cond test results were compared W 


Te, E ing. 
“alts of their first test ielinquent subgroup 


- In the case of the ken families 
Omparison boys from bro! i 
s, the the nondelinquents 
ere i t from Fo 
an ban En intact | pever, 
e e e a 


from the training school experience—mainly 
in terms of better personality organization and 
stability. Evidence is limited that subgroup- 
ings of delinquents, based on severity of of- 
fenses, responded differentially to the insti- 
tutionalization. 

5. The variable considered as the most ap- 
propriate measure of specifically delinquent 
traits, the Pd scale of the MMPI, was not 
materially affected by the delinquents’ train- 
ing school experience, a finding most pro- 
nounced in the case of boys from unbroken 
family backgrounds. 
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THE EFFECT OF ITEM STYLE ON SOCIAL 
DESIRABILITY AND FREQUENCY 
OF ENDORSEMENT 


ARNOLD H. BUSS 
University of Pittsburgh 


In recent years there has been an increas- 
ing emphasis on the variables that affect 
response to personality inventories. Endorse- 
ment of inventory items has been found to be 
affected by response set (Fricke, 1956), ac- 
quiescence set (Bass, 1955), defensiveness 
(Meehl & Hathaway, 1946), and social desir- 
ability (Edwards, 1953). The potency of 
such variables is illustrated by the correlation 
of .87 obtained between frequency of en- 
dorsement and social desirability (Edwards, 
1953), 

One approach to minimizing the effect of 
such variables is to build a “validity” scale 
into the inventory, such as the K scale of 
the MMPI. Another solution is to use a forced 
choice technique, as Edwards (1954) has done 
in matching items for social desirability, A 
third technique would be to manipulate items 
at the source: alter the manner in which the 
items are written in order to control the 
effects of response sets, social desirability, 
etc. If this approach is to be successful, it is 
necessary to discover the effect of item style 
on social desirability and frequency of en- 
dorsement. The Purpose of the present study 
was to do just this in an attempt to deter- 
mine whether item-writing might be used to 


mality” variance on inven- 


Method 


Seven item styles were used, The first con- 
sisted of the unelaborated item with no 
“stylistic” component, e.g., “I sometimes get 
into fights.” The second and third styles were: 
“I have trouble controlling (my tendency 
to)...” and “I can’t help... .” both of 
which refer to a lack of inhibition or control. 


ù 
The fourth style was: “I am tempted to - - an 
which implies that there are impulses a 
gage in the activity but conflict over a (ot 
on them or not. “I am guilty about . - - ”) 
alternatively, “I am concerned about - - e 
is self-explanatory. “Like most people “item 
appeals to a consensus. The seventh ware- 
style, “I must admit . . . ,? implies an av a 
ness of one’s own behavior, and pee 
tolerance of it, somewhat like an admis 
of minor vices. 

There were 10 different item contents: 
relating to aggression: 


all 


- I sometimes get into fights. à 

- When I get mad, I say nasty things. 

- I tend to get into arguments. 

. I tend to use strong language. ick 

- When I get angry, I sometimes pick 
nearest thing and break it. Poa 

6. I tend to te rude to people I don’t Mes 

7. I sometimes have outbursts of tempon ra 

8. When I don’t like a rule, I tend to Ð 

9. 

0. 


up the 


k it. 
- I tend to make fun of others. 
. I dislike many people I know. 


F They 
These were the unelaborated items. 


es 

were also written in the six re aT 
just mentioned. The 10 contents and onte 
yielded 70 items. The 70 items were pres s 
to 70 college men and 92 college women, oint 
rated them for social desirability. A 2P i 
scale was used, with social desirability S 
mum at 9 and social undesirability max! 
at 1. jnto 

Next, the 70 items were broken uP was 
seven 10-item inventories. No content est 
repeated within a single 10-item set. dat 
inventories were administered in stapes? 
fashion to 714 college men and women. g for 
Ss were different from the ones who rate an 
Social desirability. The number of times 
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Item Style, Social Desirability, and Endorsement 


item was answered “true” constituted its fre- 
quency of endorsement. Each S was admin- 
istered only one 10-item inventory in order 
to avoid his responding to the same content 
twice. The N for each of the seven inventories 
Was approximately 100, with a range of 95 
to 106. 


Results and Discussion 


For the purposes of the present study it was 
not necessary to use psychological scaling 
techniques in order to derive social desira- 
ility values. Therefore, the means of the 
Social desirability ratings were used, and 
these are presented in Table 1. The means 
in the bottom row of Table 1 are for style, 
Tegardless of content. The unelaborated style 
May serve as a base against which the effect 
| a various item styles may be compared.’ 

 unelaborated style yielded the lowest 
Social desirability values. The Can’t Help and 
, ike Most People styles were not significantly 
| vilerent from the unelaborated style, the £ 
alues being 0 and 1.98, respectively. The 
aailure of the Can’t Help style to increase 
cial desirability is consistent with the notion 
sg at lack of control over one’s behavior 1s 
ocially undesirable. The failure of the Like 

Ost People style is surprising, because on 


_< GY St e 


LR g 
st Each style was compared with the Unelaborated 


ier using £ tests for correlated means. For nine 
Quire of freedom, the .05 level of confidence re- 
ea S a £ of 2.26, and the O1 level of confidence 
ites a £ of 3.23. 
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the face of it this style appeals to the same 
kind of consensus that is involved in social 
desirability. 

The remaining four styles significantly 
raised the level of social desirability. For 
the Trouble Controlling, Must Admit, and 
Tempted styles the increases over the un- 
elaborated mean for social desirability were 
small but significant, f’s being 3.78, 5.67, and 
5.42. The Guilt style yielded an extremely 
large elevation of social desirability, and the 
t was 14.94. 

These data indicate that it is possible to 
manipulate social desirability simply by writ- 
ing items in different styles. Most of the styles 
yielded only small increases in social desir- 
ability, but the Guilt style was effective in 
changing ratings from social undesirability 
(a rating of less than 5) to social desira- 
bility (a rating of more than Sk 

The frequencies of endorsement are pre- 
sented in Table 2. Percentages were used be- 
cause of the slightly unequal Ws for the styles 
and contents. The means in the right-hand 
column of the table show that there are dif- 
ferences in endorsement of the contents, re- 
gardless of the item styles. The values range 
from 12.7% for “preaking things” to 67.7% 
for “temper.” These differences are of con- 
siderable importance in evaluating the effects 
of nonpersonality variables on response to 
inventory items. They suggest that the con- 
tent of the item is an important determiner 


Table 1 
Social Desirability Values for Different Item Styles 
wan r r E Y Like Unelab- 
: ‘Trouble ea ati ilty Most Tempted orated Mean 
, Content Controlling Admit Help Guilty E. Asst ; ga isis 
e aa ae a 5 2 3.5 
x fehts 30 33 3.0 34 33 32 35 
anani H an or 35 41 3.2 3.9 
q “*8uments 4.2 3.6 33 25 s es y 
* curse A 34 2.5 2.8 Kp 3 
Š. break thi ne 26 2.6 25 2.9 24 3.0 
> rude ange n 0 24 25 3.1 2.5 33 
8. temper Hs 3.8 3.6 4.0 36 36 42 
9 Teak rule. ey 3.4 28 7 Bi N 3. 
` Uslike y 3.4 zy 2.6 3. 2.8 Bi 
3.3 : 
y Mean 3.3 3.2 28 5.5 3.1 3.3 28 3.4 


ee E 
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Table 2 
Frequency of Endorsement in Percentages for Different Item Styles 
| 
Í Like ait 
Trouble Must Can't Concerned Most L ed Mean 
Controlling Admit Help Guilty People Tempted ora — 
= So — — — — -S 31.2 
1. fights 23 50 32 20 54 47 35 61.4 
eee 5¢ 76 2 78 7 76 64 AO 
2. nasty 59 79 42 78 7-4 7 i i 
3. arguments 36 42 29 16 73 59 33 SA 
4. curse 18 51 15 29 60 56 a ee 
5. break 10 12 5 24 5 22 7 ae 
6. rude 29 27 32 56 25 36 40 61 
7. temper 55 77 54 46 90 75 4 P 
8. rules 4l 45 2- 22 41 4l 3T Ri 
9. ridicule 28 77 15 40 33 34 a 19. 
10. dislike 21 22 10 14 23 32 2 
Mean 32.0 48.2 25.6 34.5 47.8 47.8 36.5 we 


of endorsement, r 
other variables, 
sulted in a rang 


egardless of the effect of 
Contentual differences re- 
e (of the means) of 55% 
in endorsement, whereas style resulted in a 
range of 21.6%. It is clear that if nonperson- 
ality variables were to be controlled, there 
would still be considerable variance attribut- 
able to contentual (personality ) variables, 
The means in the bottom row of Table 2 
reveal pronounced differences in the number 


of times an item is answered “True” 


as a 
function of ite 


m style. Again the unelaborated 


true: 
A ; o styles are © y 
made earlier concerning these style 


js 

then the tendency to endorse an nity” s 
hanced by (a) an implied a eal (ly 
admitting minor crises, (b) ath at pulse? 
consensus, and (c) emphasizing ir 
rather than actions. jal des 
Thus, item style affects both eee K 
ability and the frequency of encon ced si if 
all the styles employed here produ significa" 
cant changes, and some of Oe ee chi 
changes are perhaps too small to (oth 


cal value. However, only six ae see” 
style is the base against which to compare than unelaborated) were used, 0 be mor" 
the other styles, The Trouble Controlling, Probable that other styles mig ce 
Guilt, and Can’t Help styles all depressed 


frequency of 


endorsement, but the difference 
is significant 


Help style 
Can’t Help 


The remaining three styles all significantly 
elevated frequency of endorsement, t values 
being: Must Admit 2.27 


» Like Most People 
2.53, and Tempted 3.90, Tf the assumptions 


S. 
effective than some of the pha oe clen’ 
tainly other styles should be teste „s ma k 
that style is a potent variable, i ei A 
seen in the change from 26% to 48% us, th 
ment with content held constant. possib 
results suggest that it may well ae at os 
to control “nonpersonality” aa 
source, i.e., when the item is written- 


ar’ i 
Summary of & 


relatio? 
nt? 
nte! a 
ove 
Ab oit 


This study investigated frequency 
dorsement and social desirability i”? ni 
to item style. There were 10 item 
all concerning aggression, Each ite 
written in seven different styles: 
Controlling, Can’t Help, Feel Guilty 


Item Style, 


ped to, Like Most People, Must Admit, 
10 the unelaborated content. The 70 items 
ie 7 styles) were administered to 
aan students, and, in addition, social de- 
lity ratings were collected. 
tune found that item style significantly 
of end both social desirability and frequency 
vated orsement. Social desirability was ele- 
ling Seay ered by the Trouble Control- 
er ust Admit, Guilt, and Tempted styles. 
tee ncy of endorsement was significantly 
Cant] sed by the Can't Help style and signifi- 
Mose: elevated by the Must Admit, Like 
People, and Tempted styles. 


Social Desirability, and Endorsement 
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SOCIAL DESIRABILITY AND MMPI PERFORMANCE: 
THE INDIVIDUAL CASE! 


JAMES BENTLEY TAYLOR 


Washington Public Opinion Laboratory, 


It has been shown that much test-taking 
behavior is influenced by group norms of 
social desirability. In a recent review, Ed- 
wards (1957) cites examples of this tendency, 
demonstrating the influence of social desira- 
bility values in personality inventories, Q 
sorts, and descriptive check lists. T 
ments have demonstrated this relationship to 
be true of MMPI items (Hanley, 1956; 
Rosen, 1956). These studies report correla- 
tions between grouped data: a mean social 
desirability rating, as given by a group, is 
correlated with the probability of an item 
being endorsed. A further question remains: 
will there be a high relationship between an 
individual’s answers to MMPI items and the 
social desirability values he assigns to th 
items? The usual Practice of grouping 
data may serve to obscure a large amount of 
individual variance. It is quite possible that 
most individuals are little influenced in their 
answers by the social desirability values of 
MMPI items, and yet that the grouped data 
will show a strong relationship. In order to 
clarify this issue, it is necessary to investigate 
the correlations between social desirability 
values and item endorsements on an indi- 


vidual basis. This study reports such an in- 
vestigation. 


Wo experi- 


ese 
the 


A further question is also investigated here: 
Do people who answer the MMPI items ina 


1 Adapted from a dissertation submi 
fulfillment of the requirements for the degree of 
doctor of Philosophy, University of Washington 
1958. The author wishes to thank Allen L, Edwards, 
Lillian Favero, William Fordyce, William Kogan, 
Clifford Lunneborg, and John Mar ] 
in the completion of this research; he also wishes to 
thank the Computer Committee of 
Washington for alloting comput 
project. 


{ted in partial 


er time to this 


University of Washington 


E sit 
markedly pathological (i.e., socially Bee 
able) manner do so in spite of i norms? 
understanding of social desirability ction 0 
Or, do they answer deviantly as a fun > 
deviant notions of social desirability 
data reported here allow a test of the 
alternatives. 


two 


Procedure 


ee wer 

Three types of social desirability ore 
studied. The first of these types eatin rat 
to here simply as the “social desirabl Si how 
ings”—the subject (S) was asked to oe ip 
“desirable or undesirable” a tra mpl? 
others. The second is referred to as 1 to ra 
social desirability’—the S was re game 
the social desirability of the items "The thir 
manner as “most people” would. 1 to neré 
type of social desirability is referred medi 
as “normative social desirability’—the i com 
Social desirability rating for an item 7 rmativ? 
puted, this value serving as “n° 
rating.” iat 

Seventy male adult schizaplireni s 5 o 
in two VA hospitals, served as $s- aa g 
Ss ranged from 18 to 56, the T o this 
being 33. The MMPI had been given "0 oy, 
group as part of a routine admissions tes 
Within four months of the eee to ra 
the patients were seen again and aske valë 
205 MMPI items on a nine-point onsiste 
social desirability. These 205 items we 
of all statements in the K, D, Pd, Sc, $ wer? 
scales of the MMPI. The instruction g 7) 
adapted from those used by Edwards ( wo 
in eliciting social desirability values- ratë 
weeks later the same Ss were asked tO 
the same 205 items on the basis of ee: 
social desirability. Instructions were as 
lows: 


patie 
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u, This is a test which tells how accurately you can 
size up” the way other people behave. 

A large group of people, men and women, rated 
a number of statements. They rated each statement 
SO as to show how desirable or undesirable it was 
ay Other people. An average rating of the desirability 
of each statement was made from these judgments. 
tients mimeographed booklet contains all the state- 
ai, that were rated. Your task is to figure out 
oth the average person rated each statement. In 

er words, rate the statement like you think most 
opa did. Put your rating to the left of the state- 
e on the line provided. DO NOT SKIP ANY STATE- 
t TS; RATE kaci oNE. In making your ratings, use 

© scale shown below. 


i 9-point rating scale was used. 
it Thus each patient rated the 205 MMPI 
ems three times, first giving an item en- 
sement, secondly giving a social desira- 
paty rating, and thirdly rating the items for 
Puted social desirability. 
not Ormative social desirability values were 
hice based on data from the patient groin 
Ver. ead, 80 evening class students at the $a 
M Hed of Washington were asked to aa e 
rati PI items for social desirability. i an 
Se mgs for each item were computed; we 
tved as the normative social desirability 
Values, 
Previous studies have usually correlated the 
edian social desirability ratings as Siven by 
© group with the number of item endorse- 
woe given by another group. ‘This design 
as followed here. The probabilities of item 
“dorsement, as given by the schizophrenic 
oup, were correlated with the median socia 
stability values (the normative ratings) 
students. This corre- 


Wen, b 4 
y evening class : 
relationship between 


is describes the 
Cuped data. 
Sooners es = 2 
e ach o s p 
Correlations were between the following w 
ables: (a) Item endorsement, (b) poate = 
“trability scale values, (¢) Tmputed social de- 
Sttability scale values, and (d) Normative so- 


Cig i pence salues. Thus for each 
desirability sen V tained: These cor- 


mputed (Dvorak & 
ng the correlations, 


ichotomous vari- 
em wa dic 
endorsement ‘abl á 
es were continu- 
able, while the other vana 


including item endorse- 


u; i im 
8. AJl correlations 1 coefficients. In order 


1 individual basis were 
70 patients. These 


te Six correlations were 
y ations were machine © 


Wright, 1956). In computi 
sa 


‘0 


ent are point-biser™ 


Sis 


to facilitate computation of mean and stand- 
ard deviations, all correlations were trans- 
formed to Fisher’s Z’. 


Results and Discussion 


For the grouped data, a correlation of .79 
was found between the normative MMPI rat- 
ings and the probability of item endorsement. 
This value is similar in magnitude to those 
reported by Hanley (1956) and Rosen (1956) 
in their studies of MMPI endorsement and 
social desirability. But for the individual case, 
the relationship between item endorsement 
and social desirability was found to be rela- 
tively slight. This low correlation was true of 
all three types of social desirability studied: 
Imputed social desirability, Normative social 
desirability, and Social desirability. The mean 
correlations, computed on an individual basis, 
are presented in Table 1. 

On the face of it, these findings suggest that 
grouping the data accentuates the relationship 
between social desirability and item endorse- 
ment. It would appear that we are not justi- 
fied in assuming that social desirability ac- 
counts for much of the variance in any in- 
dividual case. In fact, for the population 
studied, social desirability accounts for only 
about 10% of the variance. i 

This conclusion is qualified, however, by 
the differences in reliability of the data. The 
grouped data, based on means, undoubtedly 
has higher reliability than does a single indi- 
vidual’s ratings or item endorsements. If we 
conservatively assume a reliability of .60 for 
oi pc i ratings and item endorse- 
the correlation between item endose nen ony 

k angie item endorsement and 
social desirability would be about .60 Thi 

-60. is 
approaches the value of the correl à 
tween the grouped dat 
gives no measure of jr 


ation be- 
s The present research 
ndividual reliability and 
a i evaluate the importance of the reli- 
ability problem to the findings 

. rt 
m a qualification must be noted too. 
a = i parse were often collected 

t e time before the social desirabili 
ratings were obtaine is time 1 cS o 
d. This time lag 

r i g may have 
ittenuated the relationship betwèen individual 


item endor Ss ividua ratings of 
sements and indi ing 

} i u en 

social desirability. 
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Table 1 


Mean Correlations of MMPI Ratings for 70 Schizophrenics 


James Bentley Taylor 


High Low barre 
Scorers Scorers Total F a 05 Level 
Correlation Between: Mean r Meanr Mean r Sig. S - 
Item endorsement o 2 52% 36 44 
Imputed social desirability 
Item endorsement 19 53** 36 48 
Social desirability R e 
Social desirability 5 A 63 
Median social desirability 56 69) 04 
Imputed social desirability 7 61 
Median social desirability 00 -67 -65 
Social desirability 2 62 
uT 4 2 
Imputed social desirability 54 -66 -62 
Item endorsement 54 
Median social desirability Al 60%" 39 
* Difference between high and low scorers significant at or beyond the .05 level. 
** Difference between high and low scorers significant at or ‘yond the .01 level, 
But in spite of these methodological prob- Summary 
lems, the findings clearly suggest that future 


research should differentiate between the in- 
fluence of social desirability norms on grouped 
data, and the influence of these norms on the 
individual case, This research also argues 
against a simplistic interpretation of the 


MMPI as being, in large part, a measure of 
social desirability, 


And what of the 


Pathological answers to the MMPI items? 
Do they have 


these questions, 
est number of 


reported in Table 1, 
As can be seen, t 
slightly deviant 


socially undesirable 
MMPI items. The “hig 
influenced by their 


‘onship P? 

This study investigates the relation if 
tween individual judgments of ore 
ability and individual item ened MMË 
Hospitalized schizophrenics endome 
items, rated them for “social desi ability’ 
and again for “imputed social desi gs er 
“Normative social desirability” rat ingt 
Obtained from 80 University of bare eo 
evening class students. pe acai of 
Item endorsement, Social desirab ad s 
mative social desirability, and Imp each © 
cial desirability were computed ree i pe 
the 70 schizophrenic subjects. In ad nt fo a 
mean probability of item endor aaa with OO | 
schizophrenic group was correlate ` th 
median social desirability rating give’ i 
student group. ‘on W 

For the grouped data, the correla ia e 
-79 between normative ratings of a ors 
sirability and probability of item ath ual 
ment, but only around .38 for the in a sin” 
case. These findings militate against M” 
plistic interpretation of individual BE w 
protocols as largely reflecting social 
bility. 
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The data also permitted a test of the hy- 
Pothesis that “people giving a large number 
j logical (socially undesirable) MMPI 
de n Bo Bive such responses as a function of 
anne of social desirability.” It was 
ron at people who give many pathological 
cae eee have slightly deviant notions of 
OBE a esirability, but that this deviancy does 
ag for their endorsement of socially 
hice rable items. Rather, high scorers an- 
ae m a manner largely unrelated to their 

Notions of social desirability. 
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THE ATTITUDES OF MOTHERS OF JUVENILE 
DELINQUENTS TOWARD CHILD REARING 


JEFF M. MADOFF 


Connecticut State Hospital, Middletown 


With the increasing awareness of the im- 
portance of the mother-child relationship as 
a determinant of child behavior, there has 
developed a strong interest in differentiating 
the child-rearing attitudes of parents of 
healthy children from those of pathological 
children. Though this kind of investigation 
has received some criticism (Orlansky, 1949; 
Symonds, 1937) as being too Specific and cir- 
cumscribed to truly measure the quality of 
the mother-child relation, its usefulness as a 
research technique has gained recent support. 
The present study was designed to determine 
if the attitudes of mothers of seriously delin- 
quent adolescents (juvenile delinquents) were 
significantly different from the attitudes of 
mothers of healthy juveniles, 


Though the study of parental attitudes has 
had a long and labored history, it has only 
been in recent years that reasonably objective 
techniques have been developed to assess the 
feelings of parents relating to child-rearing 
Practices. The works of Shoben (1949) and 
Mark (1953) and Freeman and Grayson 
(1955) have substantiated the adequacy of 
easily administered attitudinal scales to differ- 


entiate the quality of the mother-child rela- 
tionship amo i i ered groups. 


Greenbaum 


© personality configura- 
tion on the MMPI was established, Finally, 


Zuckerman, Oltean, and Monashkin (1958), 
examining mothers of schizophrenics and non- 


ity 
Afa seven? 
schizophrenics, were unable to relate x 


s z 5 izophren!a- 
of child-rearing practices to schizopl 


Method 
Technique 


„ument 
The Parental Attitude Research ma ! 
(PARI) developed by Schaefer | a aformi 
(1955) was the scale used to elicit This i 
tion about child-rearing attitudes. ii 
strument, incorporating many ae of 32 
Shoben and Mark scales, is made ie fairl 
Sroups of items, each representing pehavio® 
circumscribed area of parent-child develop” 
considered relevant to personality various 
ment. For purposes of research, t umber of 
Scales may be combined in any ae testing 
ways according to theoretical apron i of 
time limitations, specificity or gen 


> mi may 
= ——— 


: es der to taP 
interest, and reliability. In aren at Og 
broad range of attitudinal areas a f reaso” 


same time, maintain an inventory e were 
able length and complexity, 20 $ Tes of th? 
used in the present study. The sca schaele! 
PARI have been factor analyzed by Ri ack, 
and Bell (1955) and Zuckerman, simila" 
Monashkin, and Norton (1958) wae : 
results. These factors have been ex 


1. Factor A, Authoritarian-Control 

2. Factor B, Hostility-Rejection 

3. Factor C, Democratic Attitudes uon 
a ag, tg stiga 

The 20 scales used in this investis 

are: 


. Comradeship 

. Suppression of Sex 

. Autonomy of Child 

. Encouraging Verbalization 

. Rejection of Homemaking Role 
. Abdication of Parental Role 

. Irritability 

. Marital Conflict 


Pana Ne 
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9. Strictness 

10. Acceleration of Development 
11. Approval of Activity 

12. Deification 

13. Martyrdom 


14, Suppression of Aggression 
15, Dependency 
16. Intrusiveness 


17. Excluding Outside Influences 
18. Breaking the Will 


a Ascendance of the Mother 
9. Seclusion of Mother 


Subjects 


The PART was administered to 50 mothers 
of institutionalized delinquents and 57 moth- 
ers of healthy adolescents. The delinquents 
Were selected from several residential agencies 
throughout the country on the basis of age, 
Dehavior history, intactness of home situa- 
tion, and availability (for research purposes) 
of the mother, The normal youngsters were 
Selected from three school systems known to 
æ fairly representative of the general school 
Population in terms of such variables as IQ 
distribution, academic achievement, and socio- 
Cconomic level. 

he mean age of both the delinquent and 
the control sample was 14.4 years. The delin- 
Wents ranged from 12-17 years; while the 
Normal youngsters had a range of 11-18 
Years, The delinquent group had a mean sae 
Cation of 7.7 grades, with a range of 4 to i 
Brades; the normal Ss had 8.5 years of a 
mg, with a range of 6 to 12 years. Within t a 
¢linquent sample there were 10 ame 
males. Color composition was 42 whi e 
and 8 Negroes. The normal sample ee 
12 females and 45 males; 54 white youngsters 
and 3 Negroes. Te. 

The Aai age of the mothers of tie ne 
uents was 38 years, with a range © T 
Years, No information as to ase was av f 
able for the mothers of the control E: 

he mothers of both groups were Pith 4 
nantly of grammar school education, | aie 
Mean of 10.6 years for the sees o eo 
Gents and 10.7 years fF Fe her at the 
healthy sample. None an creas, wile waly 
Problem children attended © a ; 
One mother in the control sampe ad a col- 
lege education. 

In terms of religiou 
Sroups were somewhat 


s background the two 
different. The experi- 


mental group was essentially Protestant (30 
of 34 members on whom such information 
was available); the control sample was made 
up of Catholics and Protestants in about equal 
number (23 Catholics and 27 Protestants). 

On the basis of occupations reported by 
some of the mothers of each sample, it ap- 
peared that the normal sample represented a 
somewhat higher socioeconomic level than the 
delinquent sample. Within the delinquent 
sample, 13 working mothers were waitresses, 
four were domestics, and two were elevator 
operators. Among the working mothers of the 
normal sample, four were secretaries, four 
clerks, and two teachers. Most of the mothers 
of this sample did not work. 

The two samples of mothers differ some- 
what in terms of religious and socioeconomic 
background but are similar for the variables 
of education, color distribution, marital status, 
and family size. They are probably compa- 
rable in age too. 


Results and Discussion 


The two groups’ responses were compared 
on each of the 20 scales of the PARI by 
means of the chi square model. On 7 of the 
20 scales the mothers’ responses proved to be 
significantly different at the .01 level of con- 
fidence. On two additional scales a significent 
difference was obtained at the .05 level of 
confidence. In all cases of significance the 
mothers of the delinquents expressed the more 
pathogenic child-rearing attitudes. The sig- 
nificant scales are presented in Table 1. 

It is interesting to note that all nine of 
the differentiating scales had significant load- 
ings on Factor A, relating to authoritarian- 
control behavior. In contrast to this, none of 
gop “4 Ton B, Hostility-Rejection— 

a » Democrati i i 

tiated between the n e Atodlen 
would appear, then that he e 
disturbed children deae aa = 
eienn were substantially different 
= ra ers of healthy youngsters in regard 
ropa g. to behavioral controls 
Within th ca o authoritarian demands. 
stellation of attitudes certain 

scales, when taken together, seem to afford 
ee = ne description of the differen- 
eee w mothers perceptions of 
S ion to their children. Thus 
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Table 1 
Scales Significantly Differentiati 


Jef M. Madof 


EE 


ng Mothers of Delinquents 


From Mothers of Healthy Adolescents 


Mothers of 


Mothers of 


Normals Delinquents ; 

Scale Agree Disagree Agree Disagree "a 
— 0 

Suppression of Sex 10 47 28 22 ma ol 
Deification 36 21 45 5 a Ol 
Martyrdom 19 38 29 21 R ol 
Suppression of Aggression 13 44 26 24 8.5 Ol 
Fostering Dependency 16 41 34 16 15.72 0 
Excluding Outside Influence 22 35 37 13 12.14 0 
Seclusiveness 24 33 37 13 15.81 05 
Intrusiveness 21 36 29 21 4.01 05 
Breaking the Will 28 29 33 17 3.77 = 


the scales of Deification, Martyrdom, and 
Excluding Outside Influences as responded to 
by mothers of delinquents, seem to reflect the 
mother’s perception of her role 
which she sacrifices herself and he 
for her children and, in return, expects un- 
questioning loyalty, Support, and devotion, 


The cluster of Suppression of Ag 
Dependency, 


as one in 
r pleasures 


gression, 
and Intrusiveness seems to con- 
tain as its central theme the covert control of 
the child through keeping the child indebted 
to the mother, dependent and passive. This 
group of attitudes, as well as certain others, 
may relate to the concept of overpossessive- 
ness as described by Levy (1943), Finally, 
the theme of harsh, punitive control somewhat 
related to the aforementioned parental domi- 
Nance seems to filter through the scales of 


ill and Suppression of Ag- 


d through overt domi- 
nance and covert control, 
Summary 


It was hypothesize 
attitudes of mothers 


soni” 
The two groups of mothers differed Ber o! 
cantly on 9 of the 20 scales. In e 
significance, the mothers of the oa an 
expressed the more punitive, controlling, 


authoritarian attitudes. 
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SEXUAL SYMBOLISM, PERSONALITY INTEGRATION, 
AND INTELLECTUAL FUNCTIONING* 


RUDOLPH MOOS and PAUL MUSSEN 
University of Ci ‘alifornia, Berkeley 


aie have been a number of recent studies 
symbolise the psychoanalytic theory of sexual 
1954; =. (Jacobs, 1954; Jones, 1956; Levy, 
the hy tarer, 1955). Their findings support 
ee that, for adults at least, elon- 
ccs Pointed or penetrating objects—and 
Words signifying such objects—are likely 
rounds designated as male, while hollow, 
desi ed, or enclosing objects are likely to be 
aerated as female. Both psychiatric and 
Sex nal subjects respond consistently with the 
ieee hypothesis to a degree signifi- 
Cob. Y greater than chance expectancy (Ja- 
me 1954; Jones, 1956; Starer, 1955). The 
a Ponses of normals, however, reveal greater 
sSreement with the hypothesis than the re- 
Þonses of psychiatric patients (Jacobs, 1954; 
ite 1956). On the basis of this latter find- 
8, it has been maintained that “severe im- 
Pairment of personality integration is accom- 
Panied by a disorganization of symbolic 
Processes” (Jones, 1956, P- 189). Observation 
Of the performances of psychotics during a 
Symbol test led one investigator to suggest 
the “nossibility that the inability of certain 
individuals to adapt to and accept cultural 
Ges results in emotional disturbance 
tarer, 1955, p. 454)- 
i Sti fijpatiieses Bi be substantiated only 
if variables such as age, education, and intel- 
€ctual functioning are controlled. W no. ibe 
Normal and psychiatric subjects in one 0 the 
Studi were matched for age 
Udies (Jones, 1956) ie 
and education, t t ma or 


to 


hey were no 


onducted while the senior 
y trainee at the Veterans 
San Francisco, California. 


1 This research was © 
ator was a psycholog 
pinata a O express, thelr appreciation to 
Paul McReynolds an T i TR of the Veterans 
Administration ospital, A oe Alto, California, for 
their cooperation jn this study. 


intellectual functioning. It is therefore possi- 
ble that, in spite of the educational equality 
of the groups, the psychiatric subjects were 
not of the same level of intellectual function- 
ing as the normals. If this is so, their failure 
to respond as adequately as the normal con- 
trols may be regarded as a reflection of gen- 
eral intellectual inefficiency rather than of a 
failure to accept the generally prevailing sym- 
bolism of the culture or a “disorganization of 
symbolic processes” (Jones, 1956) per se. 

The purpose of the present study was to 
determine whether or not the responses of 
normals to sex symbols are more frequently 
consistent with the psychoanalytic hypothesis 
of sex symbolism than are the responses of 
psychiatric patients of the same age, educa- 
tional background, and level of intellectual 
functioning. 


Method 
Subjects 


There were three groups of 10 m 
$ S ale Ss each. 
The psychotic group had been diagnosed as 
schizophrenic and had been hospitalized in 
Veterans Administration hospital for at eee 
one year. The neurotic group consisted of 
oer who had been referred to the perches 
Jopica ae of a Veterans Administration 
ae hee ‘yea been diagnosed as neurotic 
a on group was made up of nonpsychi- 
a gery patien ‘ 
dation EAT ts at a Veterans Adminis- 
Ss i 
ie E selected in such a way that the 
ee e were equated as closely as pos- 
: va i 
elete. riables of age, education, and 
ee unctioning. The last variable was 
PES on the basis of raw score on the 
Gee ot come test of the Shipley-Insti- 
-lving Test i 
g (Shipley, 1946). The 
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s 
results of the matching of the three groups 
are given in Table 1. 


Materials 


Ss were presented with a test booklet con- 
sisting of three test sheets and an instruction 
page. The first test sheet consisted of a list of 
40 words (20 “male” and 20 “female,” listed 
in random order) taken from Jacobs’s list of 
113 words which, according to Freud’s writ- 
ings (1938), symbolized sex organs. 

The second sheet contained, in 
order, 10 elongated or pointed (male) 
and 10 hollow or rounded (female) figures, 
Some of these were taken from Levy’s study 
(1954), and some from McElroy’s (1954); 
others were specifically designed for this test. 
The third test sheet contained the 40 words 
of the Shipley-Institute of Living Vocabulary 
Test. 

The instructions, presented in writing and 
orally, were similar to those used by Jones 
(1956). Ss were asked to indicate 


random 
figures 


“whether you think it is more like a man or 
more like a woman.” 


Results 


For all three groups of Ss, and for both 
the “figures” and “words” tests (considered 
separately), the proportion of responses con- 
sistent with the sex symbolism hypothesis was 
significantly greater than the chance expec- 
tancy of 50%, Thus, these data were con- 
sistent with the earlier findings that supported 
that hypothesis (Jacobs, 1954: Jones, 1956: 
Starer, 1955), 

Table 2 Presents th 


e means and standard 
deviations for all thr 


ee groups on the two 


Table 1 
Mean Age, Mean Number of Years of Schooling, and 
Mean Shipley Vocabul 


ary Scores of the 
Three Groups of Subjects 
Mean Mean 

Mean Years of Vocabulary 

Group Age Schooling Score ` 
Normals 36.5 10.9 
Neurotics 36.7 11.5 
Psychotics 36.3 11.6 


Rudolph Moss and Paul Mussen 


Table 2 
s n 

Means and Standard Deviations of All Groups 0 
Words and Figures Tests 


__ 
Words Figures 

a sD 

i y Mean 

Mean SD —— 
See 3. 
Normal 25.0 120 IES i 
Neurotic 24.2 284 x a38 
Psychotic 25 83 WV —_— 


5 
tests. Scores were the number of repond 
consistent with the psychoanalytic sex 
bolism hypothesis. he data 

A simple analysis of variance of t ical 
from both tests failed to reveal any ra our 
differences among the three groups. Thu dings 
results are not consistent with earlier oat or 
that normal Ss respond to symbols (To sym 
figures) in Ways consistent with the ee 
bol hypothesis to a significantly greater © 
than psychiatric Ss. 


Discussion arliet 
The discrepancy between these sr fact 
findings may be largely explained by r ones; 
that, in this study, unlike the are for 
normals and disturbed Ss were matc earlier 
intellectual functioning. Thus, in the ntegra” 
studies, the effects of personality oe er 
tion may have been confounded with terior” 
fects of intellectual inefficiency or ee 
tion which are frequent a or 
Severe emotional disturbance. It was t rmane 
Possible that the relatively peor pe 
of psychiatric patients on symbolist 


t wl 
(i.e., their relative lack of agrees pete 
the sex symbolism hy othesis) was a pan 
y. yp t 


h 
of poorer intellectual functioning ag 0 
of their psychiatric status or their he pre% 
personality integration. The data of ier sinc? 
ent study lend support to this argum dis 
if emotional disturbance or persona i 
integration were the basic factor un 
the psychiatric patients’ performance, | 
scores of these Ss would have differed sig 
cantly from those of the normals. „iduals 

Apparently, groups composed of individ ze 

matched for intellectua] functioning are n 
to be equally accepting of symbols preva 
in the culture, regardless of their level 


nifi 
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“personality integration.” This finding sug- 
gests that the processes involved in interpret- 
ing sex symbols are related to other cognitive 
functions—intellectual functioning in particu- 
lar—not to emotional status alone. In this 
Connection, it is interesting to note that 
Starer had informally observed that “patients 
who were relatively more confused and dis- 
Organized [i.e., were functioning more poorly | 
made many more errors in matching than 
Patients who seemed in fairly good states of 
Temission” (1955, p. 454). 

In brief, in view of the present data, state- 
ments linking restricted acceptance of the 
Prevailing cultural sex symbols to personality 
disintegration seem overgeneralized. There 
Was no support for the hypothesis that “one 
Source of illness is the fact that there has 
Never been a complete acceptance on the part 
of the very disturbed patient of the generally 
Prevailing symbolism in a given culture” 
jStarer, 1955, p. 454). Moreover, these find- 
«8S suggest that Jones’s conclusion that 
Severe impairment of personality integration 
'S accompanied by a disorganization of the 
Symbolic processes” (1956, p- 189) is too 
“xtreme, It may be more reasonable to hy- 
Pothesize that severely emotionally disturbed 
Patients of low intellectual functioning are 
ikely to show “disorganization of symbolic 
Processes,» 


Summary 


oe purpose of the study was, 
ether or not normals, neurotics, 
“hotics, matched in age, education, and level 
Of intellectual functioning, differ in the extent 
© which their responses to sex symbols are 
Consistent with the psychoanalytic hypothesis 

sex symbolism. Thirty male subjects—10 


as to determine 
and psy- 


normals, 10 neurotics, and 10 psychotics— 

designated each of 40 words and 20 figures as 

male or female. The vocabulary test of the 

Shipley-Institute of Living Scale provided the 

measure of intellectual functioning. 

For all three groups, for both words and 
figures, the proportion of responses consistent 
with the sex symbolism hypothesis was sig- 
nificantly greater than chance expectancy. 
However, the three groups did not differ sig- 
nificantly from each other in the number of 
responses consistent with the hypothesis. 
These results support the theory of sexual 
symbolism, but they give no support to the 
generalization that emotional disturbance is 
accompanied by disorganization in the sym- 
bolic processes. According to the data of the 
present study, normal and psychiatric sub- 
jects who are equal in intellectual functioning 
do not differ significantly in the degree of 
acceptance of the prevalent cultural sex 
symbolism. 
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WEIGHT PROBLEMS AND PSYCHOLOGICAL 
FACTORS: 


JOSEPH FRIEDMAN 
Temple University 


In recent years, numerous 
appeared which deal with the psychological 
correlates of weight problems and, more spe- 
cifically, obesity. Various investigators (Bett, 
1951; Brosin, 1953; Bruch, 1941; Conrad, 
1954; Rennie, 1940; Richardson, 1946), 
working largely with incidental samples seen 
in clinical settings, have suggested that there 
are personality factors which are related to 
the weight problem, In short, weight devi- 
ancies are viewed as problems in psychoso- 
matic relationships. 

A host of traits have been ascribed to over- 
weight people, but with few validity studies. 
Among these, increased anxiety and orality, 
lack of sociability, maternal Overprotection 
and rejection, as well as a tendency for this 
problem to occur more frequently among only 
and youngest children are most often cited. 
At the other extreme, the problem of the 
underweight Person has been relatively un- 
explored. Few studies bearing directly upon 


this phase of the problem are known to the 
writer, 


articles have 


(a) anxiety level, 


(b) 
(c) energy level, (d 


stability, 


e) social 

1 This study was derived from a dissertation sub- 
mitted to the Temple University Graduate Council 
in 1958, in partial fulfillment of the requirements 
for the PhD degree. The writer wishes to express his 
appreciation to F. H. Lund, J. D 


‘ - Page, and H, C. 
Reppert for their guidance and direction, 
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‘i ; ctive 
ness, (4) cooperativeness, (i) refle 


: es onsi- 
(i) subjectivity, () acceptance of ' degre? 


bility, (2) femininity, (m) orality, (” a (0) 


t ‘ns, alll 
of positive parental relationships, & 
birth order. 


Method 
Criteria and Definitions 


Pe o 
Basic to this study is the determina ght 
what constitutes overweight and e ection 
The following criteria were set up for $ 
of the weight groups: 


ns 
z pers? 
(a) Overweight Group (OWG): those Po ive 


more * 
whose actual body weight was 10% or 


5 height- $ 
the statistical mean for their age, su at person 
(b) Underweight Group (UWG): pelo 


more 
whose actual body weight was 10% or i 
the stati 


oup> 

The tables used to delimit the ae Starks 
were those reported by Dublin ene wer? 
(1938). All weights in the present fae a d 
taken while wearing indoor clot nick the 
shoes, as were the weights from Ce iy 
reference tables were constructed. T E 
ing instrument was a bathroom sca 
had been checked for accuracy. jent 

To further reduce errors of assia 
Ss to groups, it seemed best to omit e 
line cases. Thus, weight devine a 
than 6% but less than 10% in either d! 
were not included in the sampling. 


igh 
eit a 


of 
eri 


Selection of the Sample 


; n Aeren z ages 
A questionnaire, including items on 


: a 
height, and weight, as well as other infor™ 


in 
tion (in the nature of distractors), was adm 


eeable- 
interest, (f) social ascendency, (g) ag" nes 


Weight Problems and Psychological Factors 


istered to 476 college women. One hundred 
of these women were tentatively assigned to 
the three weight groups in accordance with 
their reported data. After interviewing these 
Persons to gain their cooperation, they were 
actually weighed. Those who continued to 
Meet our criteria were included in the sample. 
Tn this manner three groups, each containing 
26 Ss, were established. 


Description oj the Sample 

The mean ages (in years) of the three 
groups were: OWG = 18.69, UWG = 20.12, 
and NWG = 20.15. The differences between 
the groups were not significant. 


The OWG had an average positive weight 
€viation of 24.8%, and the UWG had an 


average minus deviation of 13.1%. 
Testing Phase 


The Cattell Anxiety Scale, the Guilford- 
Immerman Temperament Survey, and the 
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Gordan Personal Profile were administered to 
small groups of Ss. The Blacky Test (Cards 
I and II) and the TAT (Cards 6GF and 
7GF) were administered individually at a 
second session. All measures were evaluated 
in accordance with their respective manuals 
of instruction. 


Results 


Analysis of variance (single classification) 
of the self-report measures revealed only two 
variables which differed significantly between 
the groups. These were social ascendency as 
measured by both the Guilford-Zimmerman 
Temperament Survey and the Gordan Per- 
sonal Profile (F = 5.54, P< .01 and F= 
6.95, P < .01, respectively) and subjectivity 
also measured by the Guilford-Zimmerman 
scale (F = 3.50, P < .05 > 01). To isolate 
the source of these differences, the fiducial 
limits of the differences between the means 
were calculated (Table 1). 


Table 1 


Fiducial Lim 


nits Tests Applied to the Significant Factors 


a a A E E 
PER X-xX Difference iP 
= > ; NWG-OWG = 
Ascendency (Guilford-Zimmerman scale) (17.69-17.81) 0.88 >.05 
NWG-UWG 
(17.69-13.70) 3.99* <.01 
OWG-UWG 
(17.81-13.70) 4.11* <.01 
a NWG-OWG 
Ascendency (Gordan Profile) (56.12-55.35) 0.77 >05 
NWG-UWG 
(56.12-51.23) 4.89** <01 
OWG-UWG 
(55.35-51.23) 4.12% re 
05, >. 
eee 3 L-Zimmerman scale) NWG-OWG 
Subjectivity (Guilford (19.62-16.35) 327" = 205 >01 
05, >. 
NWG-UWG 
(19.62-16.42) 3.20*#* <.08, >.01 
05, >4 
ie 
16.35- ” 
a) Beale) 0.07 S05 
~ imei 
af o1 y 
Eu E 
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The results indicate that the UWG was less 
ascendent than the other two groups on both 
measures. With regard to subjectivity, both 
the OWG and the UWG were more subjective 
and hypersensitive than the NWG. 

The projective data were independently 
rated by two clinical psychologists as to the 
degree of oral eroticism, oral sadism, and 
positive maternal and paternal relationships. 
The obtained reliabilities (% coefficient) were 
as follows: positive maternal relations = -78, 
positive paternal relations = -67, and oral 
sadism = .47. All of these were significant at 
the .01 level of confidence. Oral eroticism was 
less reliable and did not attain significance, 
This factor was considered too unreliable to 
warrant further statistical treatment. 
sis of variance of the remaining three v; 
revealed no significant differe 
three weight groups. 

In order to assess the relation of birth 
order to weight problems, the chi square tech- 
nique was used. Only and youngest children 
from our sample were combined and compared 
against all others in the three weight groups. 
The resultant chi Square value was 4.5099 
(df = 2) and did not approach significance. 
Thus, birth order was assumed to be dis- 
tributed throughout the weight range in ac- 
cordance with chance variation. 


Analy- 
ariables 
nces among the 


Discussion 


Prior to a discussion of the 
limitations of the Present stu 
Stressed. The first 
of cases studied, 


findings, two 


while significant, 
Thus, the nega- 
be due to errors 


yielded significant differences 
between the three groups. These were: (a) 


less social ascendence in the underweight 
group as compared to the other two groups 
and (b) less objectivity and more hyper- 
sensitivity among both the Overweight and 
underweight groups than in the normal weight 
groups. 


These findings may be variously inter- 


Joseph Friedman 


preted. From the classical psy choanaly 
viewpoint, the submissiveness of the thin p l 
sons might be attributed to deprivation aA 
social contact in the oral stage of infa Fee 
However, such a deprivation might Ae 
pected to produce greater oral sadism an a 
poor parental relationships as well. The P 
ent data do not support such ie 
Psychologists inclined toward the body | ig 
ogy theories might consider this findi 
be in support of the ideas of Beno 
(1925) and Sheldon and Stevens ( the 
However, according to these aes ee 
overweight persons should also be ge at 
cially outgoing than the middle apg ere iS 
as the present study is concerned th other 
nothing to support this view. On On ae 
hand, it would appear more tenable 0 fi 
that lack of ascendency on the part dinate 
underweight group reflects the pre a, 
social role which the individual of tances 
Physique has been forced in many forall 
to assume. This, rather than factors 0 ficient 
or inherent temperament, would be su 

to account for the variable. 

The second significant result of tl 
indicated that both extreme weigh d 
Were less objective in thinking he roup: 
hypersensitive than the normal weight reti 
Here, too, the author suggests an inte Either 
tion consistent with learning teny roblem 
extreme of weight presents a social n pres” 
and opens one to social disfavor. Su itivit 
sures would tend to foster hy pero arance: 
as regards physique and general a results 
It may also be mentioned that presen Seltzer 
are similar to those reported Dy ropo" 
(1946) who found that any bodily ee well 
tion was related to less stable and le male 
integrated personalities among college | ation 

In general, the results of this invete 5. 
tend to refute some widely held Coronel) 
Beyond the two exceptions already moni dis- 
there were no Psychological factors ae 5 
tinguished the three weight groups to & T 
cant degree. Studies which have provic Sa 
measure of support for the above maa 
those of Laplane and Etienne (1953), T 
sen, Juel-Nielson, Quaade, Tolstrup, mi gje 
tergaard (1951), Iverson (1953), and Mc 
(1926) with children, and Young, Beresf 
and Moore (1957) with adults. 


nis study 
t group 
mor? 


a 


Weight Problems and Psychological Factors 


“oo the investigators who have reported 
failed ee along lines that this study has 
far more es have worked with persons 
those utili eviant in regard to weight than 
such per ized in the present research. Perhaps 
ferent ech do exhibit characteristically dii- 
A ological traits, but these findings 
erately y cannot be extended to those mod- 
implied overweight as has frequently been 
aide T the literature of this problem 
: 1941, 1951; Brosin, 1953). 


Summary 


att study attempted to detect differences 
Weight pt overweight, and normal 
Ogical ollege women in a number of psycho- 
variables. Both self-report measures 

Used napis dam projective devices were 
gard. : e weight groups differed only in re- 
t is re subjectivity and social ascendency. 
e ace uggested that these relationships may 
ve hg for by simpler explanations than 
remaj een thus far offered by others. The 
ion inder of the variables under considera- 
tham oled no significant departures from 

e variations. 
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SOCIAL DESIRABILITY 


AND THE EXPRESSION OF 


AGGRESSION UNDER VARYING CONDITIONS 
OF FRUSTRATION : 


JOEL ALLISON AND DAVID E, 


HUNT 


Yale University 


That some persons 
socially desirable tr 


self-report personality tests has long been rec- 
ognized. However, 


Edwards’ (195 


+The work describe: 


d in this Pape: 
by a research } 


grant M-955 from th 


J erson of Yal i- 
versity for his helpful advice pow 
analysis. 


ud- 
as the dependent variable in the present Ai 
ies because the response of verbal agami out 
is assumed to be socially undesirable rol 
culture, at least on a general level. Ala 5 
an empirical standpoint, a correlation © k 


Cod 
has been reported between SDS and the 956): 
Hostility Scale (Merrill & Heathers; ump” 


The studies were designed to test this E uct 
tion and in so doing to evaluate the CO of th 
validity (Cronbach & Meehl, 1955) j3 that 
SDS in this respect, Assuming in ade i 
social desirability will be associated ast sol 

Suppression of aggression under at lea of the 
Conditions, the more specific poe ffect 
present studies was to investigate f ionshi 
of situational conditions upon the re ression 
between Social desirability and the exPE™ 4. 


+1 desit? 
of aggression. If the effects of social ¢ Jus 


bility could be anchored on both the P tet 
and response sides, it was felt that al 0c" 
understanding of social desirability re migh! 
ess, in contrast to an empirical factors 
be possible. 
Study I trated 

Earlier investigators have deman us 
that the arbitrariness or HEEE DEE aggre” 
tration is an important determinant 9, arbi 
sion (Cohen, 1955; Pastore, 1952), kell 
trary or unjustified frustration is mor rustle 
to produce aggression than justified tot $ 
tion. Therefore, the justifiability fac 
varied as will be described. 


Method 
Subjects 


5 
d 4 
Seventy male undergraduates were T t 
Ss in developing the measure and 62 st 
nurses in the final Procedure. 
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Social Desirability and Aggression 


Development of the Situational Frustration 
Test 


A paper-and-pencil Situational Frustration 
Test was used to present the frustration va- 
riables, Twelve frustrating situations, each 
eng a different source of frustration, 

ere presented to Ss in this phase. These 
patina situations will be referred to as 
ee because the intention of the 
T or justification of frustration is not 
sit ied. An example of such an unspecified 

uation is: “You want to hold a party at 
your house. Your mother says that it will not 
© possible for you to use the house.” 
ee to specify these situations in terms 
ae justification factor, the 12 frustrating 

Uations (in their unspecified form) were 
Presented to 70 undergraduates with instruc- 
aa to specify the conditions under which 
c X Of the sources of frustration would be 
°nsidered justified or unjustified. An exam- 
Ple follows: 

You w 


Mother sg, 
use the 


at your house. Your 


ant to hold a party 
ble for you to 


ays that it will not be possi 

house, 

(a) Under what condition would yo 
Your mother’s action unjustifiable or unwar- 
ranted? Write the first condition that occurs 
to you. ; 

(b) Under what condition would you consider 
your mother’s action justifiable? Write the 
first condition that occurs to you- 


en analyzed in 


u consider 


These free responses were thi i 
Order to determine the conditions which 
Would define each situation in its justified 
nd unjustified form. These conditions served 
to define each of the 12 frustrating situations 
a justified and unjustified form. For exam- 
ble, the situation already mentioned, in which 

e mother is the source of frustration, ap- 
Peared in the following three forms: 
ie aare? > at your house 
hold a Pa be possible for 


she has planned a 
house at the same 


Unspecified: (See examp! 


UStified: You want to 20° ©. 

Your mother says that it W 
You to use the house Pehe 
Party for her friends at 
time. z s 

E a E E 208 be. pos. 
house, Your mother SAYA ae Š poss 
ouse ona the house because it would be 
y for you e might mess up the house. 

00 noisy an 
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The Situational Frustration Test? therefore 
consisted of each of the 12 situations in its 
three forms (unspecified, justified, and un- 
justified), resulting in a total of 36 items. 
The 12 unspecified items appeared first fol- 
lowed by the justified and unjustified items 
occurring in a randomized order. Following 
each of the 36 situations, the following ques- 
tion was asked: 
What would you do? [Circle one of the five choices 
in each row.] 
Get mad at... . 
(a) certainly would; (6) probably would; (c) 
might; (d) probably would not; (e) certainly would 
not 


The statement of getting mad was made spe- 
cific to each of the sources of frustration in 
each situation, e.g., “Get mad at my mother.” 
The order of the five choices (a through e) 
was counterbalanced in each of the 36 items. 
These five choices were assigned values from 
1 for “certainly would not” to 5 for “certainly 
would” in order to permit the calculation of 
scores for the expression of aggression. There- 
fore, for each S a score ranging from 12 to 
60 could be determined for the expression of 
aggression under each of the three conditions: 
(a) unspecified frustration, (J) justified frus- 
tration, and (c) unjustified frustration. In 
addition, a total aggression score was avail- 
able for each S by summing his scores in the 
three conditions. 

In order to disguise partially the emphasis 
on aggression, two other response possibilities 
were included following each hypothetical 
frustration—“Would you keep your feelings 
to yourself?’ and “Would you forget about 
it?”—with likelihood of response recorded by 
S’s selection of one out of five alternatives as 
before. 


Procedure 


“The specific procedure was as follows: Ss 
were 62 student nurses who were tested in 
fed eo ge S first completed the Ed- 

i _?-item SDS followed by i 
a Frustration Test, ae 
he corrected split-half reliability of the 


? Copies of both Situ: 
been deposited with 
Institute. Order Docu 
for microfilm or $2.5 


ational Frustration Tests have 

the American Documentation 
ment No. 6016, remitting $1.75 
0 for photocopies. 
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> Table 1 


Aggression Scores of Extreme SD Groups Under Three 
Conditions of Justification of Aggression 


Low SD HighSD 


Condition (N=14) (N=14) Diff. ı p 

Jı i ya 5 2 <01 
Unspecified 3.07 2.56 AD 342 
Justified 1.64 1.46 AS. 122 >-20 
Unjustified 3.54 3.36 -18 89 >30 


* Higher scores indicate stronger expression of aggression, 


total aggression score was .77. The correla- 
tion between the total aggression score and 
SDS and the correlation between the aggres- 
sion score under each of the three conditions 
and SDS score were computed in order to 
determine the relationships between social 
desirability and expression of aggression. Spe- 
cific situational effects were tested by compar- 
ing the aggression scores of two extreme 
groups on the SDS. Using defining scores of 
one standard deviation above and below the 
mean, a high and low group, each consisting 
of 14 Ss, were selected. 


Results 


The correlation between SDS and total ag- 
gression scores was —,27 (b < .05)* or —.34 
when corrected for attenuation; between SDS 
and expression of aggression in the unjustified 
condition = —.14: between SDS and expres- 
sion of aggression in the justified condition 
= —.18; and between SDS and expression of 
aggression in the unspecified condition = 
—34 (p< 01). The correlational analysis 
was also supported in the extreme group 
analysis shown in Table 1 in that the mean 
aggression score of the high SD group was 
significantly lower (b < .01) than the low 
SD group under the unspecified condition. 
However, when the incidence of aggressive 
responses under justifiable and ur 


ns S njustifiable 
conditions was considered, neither of the dif- 
ferences between the SD Sroups approached 


significance, Moreover, the difference between 
SD groups in the unspecified Condition was 
significantly greater than the difference be- 
tween SD groups in the justified condition 
(p< .01) and in the unjustified condition 
(p < .05). 


‘All p values are based on two-tailed tests, 
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Results in Table 1 are in agreement with 
earlier studies (Cohen, 1955; Pastore, 1952) 
that unjustified frustration is more likely E 
produce aggression than justified fast 
Further, this greater incidence of agate 
under unjustified conditions may be noted a 
both the low SD (¢ = 17.32, p < .001) an 
high SD (¢ = 15.09, p < .001) groups. t. 

These results suggest that the effect of | 4 
SD factor is strongest in a less are. 
i.e., unspecified, frustrating situation. As mie 
information becomes available, whether in vi 
form of justification or nonjustification, 
SD effect is no longer present. 


Study II 


Of the many factors besides justifiabh! 
which determine reactions to frustration ( 30), 
lard, Miller, Doob, Mowrer, & Sears, or. 
we selected two others in order to nel fhe 
ther the possible situational specificity a F 
effect of social desirability: (a) sirena 
motive being frustrated and (b) ei e 
of responses alternative to the frustrate a 
sponse (whether or not an alternative oe 4 
is present for circumventing ie 
That is, expression of aggression shoul 
erally increase as a function of incre ez 
motivation and decreased alternative no! 
sponses. It should be noted that we a: 
presently concerned with studying these 1 re 
effects of the motivation and alternative 

fi 


5 he 
ee : ° gate t 
sponse condition. We wish to investiga fag 


se! 


jon 0 
nature of SD effects upon expression sitions 
gression throughout this range of cond 


Method 
Subjects 


u- 

One hundred and seventy-one ndk es 
ates, comprised of 82 males and 89 fe 

were used as Ss, 


Development of the Second Form of the 
Situational Frustration Test son 
ti0 


Another form of the Situational Frustt’ nis 


Test (see Footnote 2) was developed ae 
study. Two variations of both motive ape 5, 
and alternative response generated four © was 
of frustrating situations. Motivation, jot , 
varied in the first portion of the descr se 
of the situation, while availability of resP 


Social Desirability and Aggression 


alternative was varied in the last portion of 
the description as the following examples 
indicate. 


. = 


(a) Low motivation—alternative response 
available. 


Someone has suggested to you that you have a 
Party at your house but you are not sure whether 
or not you want to have one. Your mother says 

| that it will not be possible for you to use the house. 
You think that you can probably use the apartment 
of a friend. 


(b) Low motivation—alternative response 
unavailable. 


Someone has suggested to you that you have a 
Party at your house but you are not sure whether 
or not you want to have one. Your mother says 
that it will not be possible for you to use the house. 


(c) High motivation—alternative response 
available, 


You have been looking forward to having a 
Staduation party for your closest friend. You set up 
all the plans. Your mother says that it will not be 
Possible for you to use the house. You think that 
you can probably use the apartment of a friend. 


(d) High motivation—alternative response 
unavailable, 


You have been looking forward to having a 

Staduation party for your closest friend. You set up 

_ ll the plans, Your mother says that it will not be 
Possible for you to use the house. 


These examples present one of the basic 
Situations expressed in each of the four forms. 
€ test consisted of 12 such basic situations, 
each expressed in four forms, or a total of 48 
‘tems. Ttems were presented in blocks of 12 
According to the above order, i.e, (@) first 
in (d) last, with items randomized within 
blocks, This order by blocks constituted a 
Progressive increase in frustration which was 
w «Smed necessary in order to avoid possible 
.ansfer effects” of strong frustrating situa- 
Ons Preceding the weaker frustrating situa- 
ns. In addition, analysis of responses to 
ee as well as preliminary data indicated 

ex there are no systematic differences mM 
Pression of aggression attributable to item 
Sition alone. o 
hing Study II, Ss again indicated the Teel 
With Of their expressing aggression on a seals 
ve response alternatives which per- 
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Table 2 


Effect of Social Desirability and Nature of Frustration 
Upon Expression of Aggression 


df MS F P 


Social Desirability 
(High SD vs. 


Low SD) 1 2,887.04 19.98 <.001 
Error 46 144.50 
Frustration 3 1,537.60 83.66 <.001 
Social Desirability X 
Frustration 3 45.69 249 <.10 
Error 138 18.39 
‘Total 191 


mitted determining aggression scores for the 
four conditions already described. Therefore, 
scores for each S were available for each of 
the four conditions and for the total of the 
four conditions. Ss were tested in groups of 
25 or 30 with the administration of the SDS 
preceding the situational frustration test. 
Extreme group analysis in this study was 
based on 25 Ss in the low SD group (14 
females and 11 males) and 23 Ss in the high 
SD group (9 females and 14 males), extreme 
groups again defined by cutting scores of one 
standard deviation above and below the mean. 


Results 


The correlation between SD and total ag- 
gression for the 171 Ss was .43 (p < .01). 
For the 82 males, 7 was .44 (p < .01), and 
for the 89 females, y was 42 (p<.01). 
Analysis of variance presented in Table 2 
indicates that the aggression scores of the high 
SD group were significantly lower than those 


5 


4 


| 
J 
= 


MOTIVATION: w Low 
ALTERNATIVE RESPONSE: PRESENT ABSENT 


INTENSITY OF 
AGGRESSVE 
RESPONSE 


HIGH HIGH 
PRESENT ABSENT 


Fig, 1. Mean aggression scores of extreme groups 
in four frustration conditions. 


532 Joel Allison and 


of the low SD group (p < .001). In addition, 
there was a significant difference among the 
four conditions of frustrations (p < .001). 
Figure 1 presents these results by condition. 
When extreme group comparisons are made by 
condition, the low SD group expresses signifi- 
cantly more aggression in each of the four 
conditions of frustration. Extreme group com- 
parisons were also made separately for males 
and females. In this analysis, seven of the 
eight comparisons led to significantly greater 
expression of aggression in the low SD group. 
Only the difference between extreme group 
males in the low motivation-alternative re- 
sponse present condition failed to reach sig- 
nificance at < .05 level. 


Discussion 


The findings of these two studies indicate 
that the social desirability factor exerts a 
situationally specific effect upon the verbal 
expression of aggression. In considering the 
results of Study I, it may be noted that the 
two conditions which specified the justifica- 
tion of the source of frustration also implic- 
itly define the culturally approved response 
more clearly than in the unspecified condition. 
That is, aggression is usually sanctioned as 
a response to unjustified frustration and pro- 
hibited as a response to justified frustration, 
If we assume that the high SD group is sensi- 
tized to the cultural acceptability of a re- 
sponse, then we may note that under condi- 
tions of cultural acceptance, as implied in the 
unjustified frustration condition, the high SD 
group is capable of responding with verbal 
aggression, Furthermore, it is important to 
note that the effect of the SD factor is most 
Pronounced when the situation is more am- 
biguous as in the unspecified condition. 

That the high SD group expresses less ag- 
gression in all four conditions of Study IT 
further emphasizes that the “suppressing” 
effect of the SD factor occurs primarily in 
situations in which the culturally acceptable 
response is not evident. That is, the informa- 
tion provided by the conditions in Study IT 
pertained to the psychological or “internal” 
state of the recipient of frustration rather 
than to the intention of the source, There is 
a suggestion from the results of these two 
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B 
studies that persons high on the SD facto 


are, in Riesman’s (1950) terms, eer 
directed” rather than “inner-directed, 
such a possibility requires further reseal' 
support. 


Summary 


The relationship between Edwards’ Social 
Desirability Scale (SDS) and espress gi 
aggression as measured on a paper-and-pi ; te 
situational frustration test was invest Ena 
in two studies with the following i- jn 
When responding to frustrating situa 
which the intention of the frustrating p ress 
was not specified, Ss high on the SDS on e 
significantly less aggression than Ss low 0 a 
SDS. This greater tendency to express vathel 
sion in low SD Ss was noted in four tyne tate 
cal variations involving the psychologica Es e 
of the recipient of frustration. Howey a 
socially normative information in the fo pro- 
specifying the intention of the source v n 
vided, the effect of the SD factor Wa 
longer present. jes 

The Bred results of the two stug 
are taken to indicate construct validity the 
the Edward SDS and to eng i 
situationally specific role of the socia ‘da 
bility factor in determining the express! 
aggression. 
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CORRELATES OF ATTITUDES AMONG CLINICAL 
PSYCHOLOGY STUDENTS: 


SHELDON R. ROEN 
University of New Hampshire 


Distinctions have often been made between 
Psychologists who freely draw interpretations 
Bee ly from the material with which they 
vork and those who prefer some quantita- 
aed reliable instrument on which to base 
i Conclusions. Shaffer (1953) investigated 
a 'S distinction with a scale designed to meas- 
re “objective—intuitive” attitudes. In sam- 
Pling members of Division 12, he found that 

jective and intuitive attitudes were highly 
related to the training the psychologists re- 
ceived and to the work they have done. A 
Urther question could be asked: does a stu- 
ent enter the clinical program with a pre- 
Conceived set based on broader patterns in 
us Personality, or is his subsequent orienta- 
on Primarily a function of his perception of 
the expectancies of the significant person in 
Us training? Conceptualizing the problem in 

ls way focuses on the points of difference 
tween role theory and the self-consistency 

YPothesis, 

Role theory, according to E 
(1952), 


arsons and Shils 


; tations 

++ involves a set of complementary a those 

concerning (an individual’s) own actio saian arta 
°f others with whom he interacts. - - - 


vith 
8 . z ly congruous Wi 
vautionalized when they hare are organized 


of conformity with ae 
of value orientations shared Dy 


i i role func- 
Members of the collectivity in which the role 


T ho- 
t the American Psyc 
Thi: resented 2 i September 
logical Pre meeting at CPOE to 
9 Associati! Ate dissertation subn 4 
ee is based upeplumbia University, in partia 
Wea College; equire ents for the egre of doc- 
illment of the re t committee members were 
Pri rof philosophy Edward J. Shoben, Jr., and 
aurance F. Shall”: rhe author was a participant 
i bert L: Thorn psychology Program at the time. 
the Army Se? 


l 
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In its most elementary form, role theory 
would be inclined to look for the current in- 
terpersonal setting surrounding the initial de- 
velopment of attitudinal patterns. 
Self-consistency theory, on the other hand, 
emphasizes the prime need of an organism to 
maintain its mental organization as a unified 
whole. In the words of Lecky (1945, p. 81), 
“Tt is our view that behavior is usually ‘in 
character’ not because the separate acts are 
related to one another, but because all the 
acts of an individual have the goal of main- 
taining the same structure of values.” Varia- 
tions of the self-consistency hypothesis might 
include Adler’s (1946) “style of life” con- 
struct and Goldstein’s (1939) postulation of 
the one drive of “self-actualization.” In its 
extreme form, this view conceives of indi- 
viduality as a central, unitary, indivisible, 
striving process, and would look to the “basic 
nature” of an individual in understanding the 
reasons for his incorporation of new attitudes. 


Method 


A seven-page questionnaire was developed contain- 
ing material in the following order: questions relat- 
ing to biographical data; a shortened form of Ey- 
senck’s (1947, 1953) radical-conservatism and tough- 
tender minded factors; the restraint and masculinit: 
scales from the Guilford-Zimmerman “Teranerainen 
peer (1949) M 10 items each from Thorndike’s (1954 
EGA gt Reh ee psychometric (measure- 

a 2 nenting activity preference clus- 
sition 5 paired comparisons; multiple-choice 
ee ger ating to the profession and work of the 

uential and significant Person in the stu- 
Shaffer's (1953) list of 21 adjectives 
tudent could circle the attributes he 


Person; and Shaffer’s (195. 


w 
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Table 1 


Intercorrelations among Scaled Variables 


Exp.- Meas- Exp- 


eas. 
Scale T R Restraint Masc. Help. Help. Mea: 

5 5 Ar" 
Objective-intuitive 03 5. 01 -15?* 45** apa A 
Tough-tender minded (T) — 34 =i .08 .03 EF rf 
Radicalism-conservatism (R) —.13 03 00 = 02, > 
Restraint —.09 = 09 = “a “ase 
Masculinity : 22 IER “ae 
Experimenting-helping 5 “tee 
Measurement-helping 


* Significant beyond the .05 probability level, 
oe enifcant beyond the .01 probability level, 


were asked to cooperate b 
psychology students to fill 
anonymously, Nine universi 
be included in the main investigation, and 291 blanks 
were available for analysis, The sample represented 
65% of the clinical students at the nine schools. The 
remaining two schools responded late and the data 
obtained from them was used only in comparing uni- 
versities. Two of the universities were from the East 
Coast, five from the Midwest, and two from the 
West Coast. 

Reliabilities of the eight scales included in the 
questionnaire were based on a random sample of 100 
Protocols. The split-half method, corrected by the 
Spearman-Brown formula, produced the following 
reliabilities: objective-intuitive scale, .86; helping, 
psychometric, and experimenting activity preferences, 
:89, .79, and .86 respectively ; restraint, .67; mascu- 
linity, .77; tough-tender mindedness, 52; and radi- 
cal-conservatism, 67. The homogeneity of the group 


sampled may have been responsible for lowering 
Some of the coefficients, 


y requesting their clinical 
out the seven-page blank 
ties responded in time to 


Results 
Relations among Scaled Variables 


Table 1 presents the product-moment inter- 
Correlations for the sca] 


or 
urement, and experimenting preferences y: 
related —.46, —.27, and .53, ig 
with objective-intuitive attitudes. ios 01 
these coefficients is significant beyond 
level of probability, 

An inspection of the remainder of ‘ 
reveals other interesting relationship 4 
straint appears to be slightly correla ie 
Conservatism and the helping ena prefer- 
measurement-helping dimension o culinitY 
ences. The relationship between man were: 
and objectivity is cross-validated, as 1 end of 
by its relationship to the experimenta rime!” 
the experimental-helping and the exP 
tal-measurement activity preferences. 


table 
he Be 
with 
e 


Years of Training 


+ antur 
+ ve-in 
An analysis was made of objecti in the 


tive attitudes with regard to year reer 
clinical program. Mean scores an h educa” 
deviations were calculated for eac ere, ful 
tional level, and the distributions W scenti 
ther divided at the 30th and 70th ee 5 
to see if strong attitudes were HI 
the student progressed in the prog" 
analysis of variance and £ ee 
means, standard deviations, and t fot ¥' 
ences between strong attitude means jectiv 
levels proved to be insignificant. Obj 
intuitive attitudes would seem not tO 
function of educational level. 


Most Influential Person 


Two multiple 
respondents to 
work of the mo. 


ced the 
-choice questions asked "4 


Sa san aCe 
indicate the professo cok 
st influential and signi 


pr“ 


Attitudes of Clinical Psychology Students 


person in their training as psychologists. Of 
the categories that might have been selected 
as the profession of this person, only three 
(clinical psychologist, other psychologist, and 
Psychiatrist) were chosen by enough students 
to be adequately compared. Table 2 sum- 
Marizes the responses to the two questions. 
he only comparison not significant beyond 
the .05 level was that of psychiatrists vs. all 
others, However, when a test was drawn com- 
ining the psychiatrist and the clinical psy- 
chology groups as against all the others, a ¢ 
even larger than that for the clinical psychol- 
OBY group alone was obtained. It would seem 
that students who were influenced by clinical 


Table 2 


Tests for Significance between Mean Objective- 
Intuitive Scores for Profession and Work 
of the Influential Person 


SD t p 


Profession Number Mean 
Clinical 
Psychologist 187 42.98 6.38 
2.25 .012 
All others 92 45.00 7.32 
Other Psychologist 62 46.24 7.58 
3.18 .001 
All others 217 42.90 6.32 
Psychiatrist 25 4202 6.30 
1.34 .090 
All others 254 43.80 6.79 
Psychiatrist & 38 
clin, ist 212 4288 6. 
psychologist 1 3.24 .001 
All others 67 46.12 7.36 
Work 
Pract 1.67 5.82 
ice 109 4l. 4.28 001 
Research & Train- 
ing 177 4.96 7.02 
Rese 7.95 
search 43 46.68 271 003 
Practice & Teach- 
ing 243 43.18 6.42 
Teaching 134 44.40 6.61 165.049 
Practice & Re- a Ps 
search 152 43.08 6.85 
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psychologists or psychiatrists were signifi- 
cantly more intuitive than those who were 
influenced by other psychologists. 

The second section of the table suggests 
that students whose influential figures were 
engaged in practice were significantly more 
intuitive in their attitudes than those who 
were influenced by people primarily engaged 
in research. Students influenced by teachers 
elicited intermediate attitudes, but tended to- 
ward objectivity. 

The adjectives circled as descriptive of the 
most influential person were conceived as fall- 
ing into two groups, “warm” and “cool.” 
Sympathetic, natural, and sensitive were M- 
cluded in the warm group, and hard headed, 
painstaking, and reserved formed part of the 
cool group. The congruence of these cate- 
gories with perceptions of objectivity or in- 
tuitiveness is discussed by Shaffer (1953). 
The mean numbers of warm and cool adjec- 
tives circled by students scoring in the upper 
and lower 27% of the objective—intuitive dis- 
tribution were compared and ¢ ratios calcu- 
lated. A similar analysis was made of ad- 
jectives previously found by Shaffer to be 
significant in distinguishing psychological at- 
titudes. In each case the difference between 
the means was found to be significant beyond 
the .001 level of probability, indicating that 
objective—intuitive attitudes of students cor- 
respond to the descriptions they give of the 
influential person in their training. 

Of the six items in the multiple-choice ques- 
tion that asked why a student associated with 
the person who influenced him most during 
his training, three of them (assigned to me; 
by chance or requirement; selected by him) 
were considered indicative of chance choices, 
and the other three (I selected him; I chose 
to interact with him; he impressed me most) 
were considered to reflect personal need 
choices. The space for a freely written ais 
swer, and the circling of both need and chance 
items by some of the respondents, left 
siderable latitude for ing 0 E 
dents: Wrote thar ches scoring. Fourteen stu- 
influential e Ent A ig aaa 

i : al chi square compu- 
AEA mae between the dumber of 
indicated ch Strong and weak attitudes who 
strong and anae reasons, and those with 

weak attitudes who gave need 
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reasons. The upper and lower 27% of scores 
on the objective-intuitive scale defined the 
strong attitude group, and the middle 46% 
were considered to have weak attitudes, Sig- 
nificance was obtained when it was assumed 
that where both need and chance items were 
selected, need was Prepotent, and where 
therapist was written in, this, too, reflected 
a need choice. Granting these conditions, it 
can be said with reservation that students 
with strong objective or intuitive attitudes 
selected their influential figures more on the 


basis of their own needs than for other con- 
siderations. 


Comparison of Universities 


itive score for the 
ith a standard de- 
ores were grouped 
the means ranged 
with the most in- 


ion of .76 emerged 
udents. This js sig- 
f probability, 


between graduates and st 
nificant at the .03 level o 


Other Relationships 


» and only 14 
little can be 


obtained in the com- 
on and work of the 
Suggested that rela- 
tween this and other 
ssions and work were 


most influential person 
tionships might exist be 
variables as well. Profe 


Sheldon R. Roen 


dichotomized on the basis of their we 
ship to objective-intuitive attitudes. Po ii 
biserial correlations of .25 and 22, a 
cant beyond the .01 level, were obtaine wih 
tween restraint and the profession and a 
respectively, of the most influential Paid 
No significant relationships with mascu 
seemed to exist. 


Discussion 


Ae. 
Some of the evidence suggests that on 
tive-intuitive attitudes of clinical bak re- 
students are shaped by the training i tu- 
ceive, possibly in terms of learning TO A that 
dents with intuitive attitudes indica ae 
the most influential persons in their mE 0- 
were “warm” or “intuitive” clinical pete en: 
gists or psychiatrists who were pine in 
gaged in practice. Objective students Tia a 
fluenced by other psychologists, desc in Te- 
“cool” or “objective,” who engage elation” 
search or teaching. The significant students 
ship in attitudes obtained between $ s als? 

and graduates of the same universitie 
tends to confirm this hypothesis. r “self 

However, the existence of a set ° rior 
consistency” motive among students Ras a 
their entrance into a clinical program a rela 
be supported by the data. Significa an itt 
tionships were found to exist betwee - 
grained trait like masculinity and ctivily 
jective attitudes and experimenting vith the 
Preferences. Restraint was associated T figures 
Profession and work of the influentia was fur 
With some procedural reservations 5 g atti 
ther found that students with stroni 


to 

i + tttive chose 
tudes, either objective or intuitive, ced the” 
associate with the person that influen eeds 


most more on the basis of their one es 
than for other considerations. If ree fac- 
during graduate training were a prin gecom? 
tor, psychological orientation should in the 
more distinct as a student advances He 


5 rue- 
program. This was not found to be t 


g 

strode 

nally, it might also be argued that mg obje“, 
relationships found to exist betwee? | of 


tive-intuitive attitudes and the selection 

future professional activities could suPP 5 oÍ 

predisposition hypothesis, since the tYP de 

work a student wants to do is usually dec am: 

before he enters a graduate training proud: 
It seems plausible that there are two K! 
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of student. One type could enter the program 
with a set toward a specific orientation and 
another could enter with an open mind, and 
thereby be more susceptible to influence. 
Other interpretations of the data might in- 
clude the possibility that some students were 
influenced while undergraduates and are actu- 
ay reflecting their relatively more immediate 
tga than their more basic nature; or 

at students’ attitudes develop very quickly 
during their first year of graduate training 
and continue for the most part as they were. 


Summary 


cho iective-intuitive attitudes of clinical psy- 
i ology students were investigated in an at- 
empt to delineate the forces that might be 
Operative in their development. Students from 
Universities responded to a blank contain- 
oe Measures of social attitudes, temperament 
traits, professional activity preferences, and ob- 
Jective-intuitive attitudes. Information about 
the most influential person in their training 
and personal biography was also solicited. 
The data seemed amenable to various in- 
terpretations, including the possibility that 
Many clinical psychology students entered a 
training program with a preconceived orien- 
tation toward objective-intuitive issues based, 
Perhaps, on broader self-consistency patterns 


in their personalities. Other interpretations 
suggested were susceptibility to undergradu- 
ate or very early graduate influence, and that 
some students were self-consistent and others 
were role players. 
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REQUISITE CONDITIONS FOR BASIC PERSONALITY 
CHANGE! 


ALBERT ELLIS 
New York City 


Many proponents of different schools of 
psychotherapy—such as Freud (1950), Rank 
(1945), Reich (1949), Reik (1948), Rogers 
(1957), and Sullivan (1954)—have claimed 
that certain conditions must exist 
tinue over a period of time if basi 
ality change is to be effected in dist 
dividuals. It is the contention of t 
that there are probably no absolut 
sary conditions for constructive 
change. 

Perhaps the clearest an 
Stated set of requisites fo 
sonality structure of the 
surface and deeper levels, 
(1957), who lists six “neces: 
conditions” 
pist) are in 
ent is in a 


and con- 
c person- 
urbed in- 
his paper 
ely neces- 
personality 


d most operationally 
r change in the per- 
individual, at both 
is that of Rogers 
sary and sufficient 
: 1. Two persons (client and thera- 
psychological contact. 2. The cli- 
state of incongruence or anxiety. 
3. The therapist is congruent or integrated in 
the relationship. 4. He experiences uncondi- 
tional positive regard for the client. 5. The 
therapist experiences an empathic understand- 


ing of the client’s internal frame of reference 
and endeavors to ¢ 


standing and unco 


to a minimal degree achieved. Although an 
initial Consideration of Rogers’ conditions 
makes them appear to be most reasonable 
and valid, more sober reflection Provides some 
serious reasons to doubt their “necessity.” 
Among these reasons are the following: 

1. The necessity of two Persons being in 
psychological contact for one of them to 


1 Condensed version of a Paper rea 
shop on psychotherapy of the Americ; 
Psychotherapists, held in Madison, 
gust 9, 1958. 


d at the work- 
an Academy of 
Wisconsin, Au- 


: ingly 

change his personality structure is rai 0 
belied by the thousands. perhaps a oc- 
significant personality changes that encoun- 
curred when a single individual (a) ed suff- 
tered external experiences and lear asoni 
ciently by them to restructure his Pb) with- 
and behavior patterns of living or with am 
out entering any real relationship Jisten® 
other, heard a lecture, read a book, a pasi 
to a sermon that helped him mak 
changes in his behavior. eaiuidual must 

2. The assumption that an indivi jety {07 
be in a state of incongruence or oe con 
Personality change to occur is en in- 
tradicted by the reasonably freq nanxio" 
stances of distinctly congruent and s onali i 
individuals who improve their perading 
significantly by life experiences or repiatrist® 
(as in the case of psychologists, PS ply fro 
or social workers) benefit ane train” 
therapy which they entered largely p 
ing purposes. jra 

3. Although it is doubtlessly mps E i 
for a therapist who is trying to ie P elati 
to be, within the confines of ol pe 
ship, a congruent, genuine, integrat sands of 
observation of a good many anil invest” 
counselees may well lead the hones ro ably 
gator to admit that some, though, Ipe by 
not many, have been considerably a were 
their relationship with therapists hes ip 
(a) disturbed and incongruent indiv pi 
their own right and, in some instan earl ed 
incongruent, hypocritical, and 1 -9 
in their relationship with these alien ache 

4. Although, again, the therapist S$ yt pis 
encing unconditional Positive regard ctive 
client is surely a desideratum of effe w 
therapy, there seem to pe more than 4 inl 
cases on record where therapists have ™4 


538 


2 


` NO patients make fu 


Requisite Conditions for 


tried to regulate the lives and philosophies of 
their clients for the satisfaction of the thera- 
pist? own desires and where, nonetheless, 
emotionally exploited clients were consider- 
ably helped. 

5. Even the therapist’s experiencing an ac- 
Curate, empathic understanding of the client’s 
awareness of his own experience would ap- 
Pear to be desirable but unnecessary for ef- 
fecting constructive personality change. More 
than one therapist has, with little or no em- 
Phatic understanding of his patients, indoc- 
trinated some of them with a philosophy of 
life that proved to be considerably helpful; 
and some of the greatest bigots of all time, 
Such as Savonarola, Rasputin, and Hitler, 
Who, because of their own severe emotional 
disturbances almost certainly had a minimum 
of empathy with their fellow human beings, 
‘nduced profound personality changes (at 
least a few of which were probably construc- 
tive) in their adherents. , 

6. It would seem, at first blush, almost in- 
disputable that unless, as Rogers contends, 
the client perceives, to a minimal degree, the 
acceptance and empathy of the therapist, he 
will not significantly change. But second 
thought presents an open-minded theorist 
With the fact that apparently some paranoid 
Patients become significantly improved in Los 
Course of therapy and still will not admit : a 

eir therapists really understand iher, IE 
Others may recover from their paranoid ait 2 
ing and only after significant personality 
Change has been effected perceive oe 

In the light of the aan hypothesized 
th oe perhaps he mee ignificantly restruc- 
ane very few individuals sis Rowers’ six con- 
ure their personalities when t dubious that 
nitions ate unme eS tei dubious that 
st dn. Similarly, A ee] con: 
as Freud (1950) con- 
d resolve a en 
£ z; or, as Rank 
ence neurosis during the thee a highly per- 

1945) insists, they trictly limited relation- 
Missive and then 4 R t: or, as Reich (1949) 
Ship with the era Peik character armor by 
Claims, they Joosen tacked by the therapist's 

ding it forcibl physical uncoverings; or, 
Psychological a” 


'Nprovements unless, 
tends, they undergo an 
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as Reik (1948) notes, they are effectively 
listened to by the therapist’s “third ear”; or, 
as Sullivan (1954) opines, they undergo an 
intensive analysis of the security operations 
they employ with the therapist and with sig- 
nificant others in their environment. All these 
suggested therapeutic techniques may be 
highly desirable; but where is the evidence 
that any of them is necessary? 

Are there, then, any conditions that are ab- 
solutely necessary if basic personality change 
in an individual is to occur? Probably not, if 
we think in terms of any particular condi- 
tion or set of conditions. This null hypothe- 
sis can perhaps most quickly be tested if any 
theorist takes his own special theory of ther- 
apy and, with ruthless honesty, asks himself: 
Could xo human being basically change his 
behavior were he and his therapist to ignore 
the essence of my theory and practice? 

To test this hypothesis, the present author 
considered the essentials of his own special 
theory of rational psychotherapy which he 
has been developing for the last several years 
(Ellis: 1957, 1958a, 1958b, 1958c). The first 
fundamental assumption of this theory is that 
for real or basic personality change to occur, 
the individual must somehow learn to recog- 
nize his irrational, unrealistic perceptions and 
thoughts and change these for more logical, 
more reasonable philosophies of life. In hon- 
estly questioning whether this is a necessary 
condition for personality change, however, 
the following doubts arise: 

1. Some people seem to make significant 
changes in their personalities without con- 
comitantly acquiring notably new philoso- 
phies of living. It could be said, of course, 
that they really, unconsciously, do acquire 
such new philosophies. But this would be 
difficult to prove objectively. 

2. Some individuals appear 
the better when environment 
modified, even though they 
childish views, Thus, a pers 
ae hates himself because 
Sau pat less if he inherits a for- 
Ate frorn Ti e said that the security he re- 
make him E ie E money really djes 

ge his childish, irrational views. 


But again: there would be difficulty in objec- 
tively validating this contention. ` 


to change for 
al conditions are 
retain their old 
on who irration- 
he is poor may 
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3. The statement that for constructive per- 
sonality change to occur the individual must 
somehow basically change his thinking or his 
value system may be basically true; but it 
is also somewhat tautological. For in making 
such a statement one is really saying that 
poor personality integration consists of an 
individual's having unrealistic, self-defeating 
ideological assumptions and that to change 
his personality integration for the better he 
must surrender or change these assumptions. 
Although descriptively meaningful, this state- 
ment boils down to the sentence: in order to 
change his personality the individual must 
change his personality; or: in order to get 
better he must get better. This Proves very 
little about the “necessary” conditions for 
personality change. 

Again: rational psychotherapy significantly 
differs from virtually all other theories and 
techniques in that, according to its precepts, 
it is desirable not merely for the therapist to 
uncover, understand, and accept the client’s 
illogical and unrealistic assumptions which 
cause him to remain immature and ineffec- 
tive, but it is usually required that he forth- 
rightly and unequivocally attack and invali- 
date these assumptions. Is this desiderata of 
psychotherapy necessary? Most probably not: 
since some clients and nonclients (although 
relatively few, I believe) seem to have sig- 
nificantly improved in spite of their not hay- 
ing the benefit of a competent rational thera- 
pist to help them understand how they ac- 


ly sustaining, 
and how they can and should forthrightly 


asic irrational 


1 SiC constructive person- 
ality change—as opposed to temporary symp- 
tom removal—seems to require fundamental 
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modifications in the ideologies and valg z 

tems of disturbed individuals, there a y 
ably no single condition which is al Shan 

necessary for the inducement of such ¢ cond 
attitudes and behavior patterns. Many Rank, 
tions, such as those listed by Preu out- 
Reich, Reik, Rogers, Sullivan, and ot my P 
standing theorists, or such as I list ich de- 
pers on rational psychotherapy, are his SA i 
sirable; but all that seems to be nece agains 
that the individual somehow come "y a 
significant life experiences or lear ink {ot 
himself or enter a relationship ba. 
pist who is preferably congruent, 4 


or 
i er/| 

empathic, rational, forceful, oe the onl 
rather than this-and-that seems to ndition® 


sa (abe co! 
realistic description of Hegeman be ma 
for basic personality change that ca 


at the present time. 
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A NOTE ON AN INDEX FOR THE COMPARISON OF 
PROFILES ON THE “CIRCLE” ' 


WILLIAM L. HAYS 


University of Michigan 


An Index for Two Individuals 


The problem of the comparison of profiles on 
the coding device known as the “Circle” 
(Freeman, Leary, Ossorio, & Coffey, 1950) 
arises whenever behavior of an individual has 

een coded in this way and one wishes to com- 
Pare his pattern of behavioral trends with the 
Pattern for another individual (or with the 
Pattern for the same individual at another 
lime). In the past this problem has been 
handled simply by doing a chi square compari- 
Son between the relative frequencies of codings 
Mm the various categories of the Circle for the 
Profile. Another alternative has been to rank 
order the relative frequencies in the categories 
Or the two individuals and to compute a rank 
Correlation measure between them. Both of 
Nese procedures, however, have ree con- 
Sidered inadequate since they seem to do vio- 
ence to the essential idea of the Circle: this is 
that the categories of the Circle are Fpa 
t0 be ordered in the fashion reflected Pe t ae 
ârrangement on the circle. Such fe ei) 
Seem to ignore the “circularity of tt oe tte 
Categories when the pattern comparisons © 
Made. CA r 
The technique proposed herein 1S designed 


i dering 
to incorporate this idea of a circular or 8 


Laer i ween 
into a measure of pattern similarity bey 


xplic- 
individuals. The unit of seas y 
rp tly adopted here ite aaa Chiles that 
| between two categories Divae same category 
two observations falling inte 3 identical. Two 
are, for all relevant pup. cent categories 
Observations falling into 29 [ 
jed out in connec- 
here was carrie! i 
ion wi h program Of ea Tastitut 
on with a research PV." from the Nation ute 
Ported by grant M- National Institutes of Health, 


Of Mental Health of t Survice: 
itea States Public Health Se 


| The work reported 


are at a unit distance; two observations falling 
into categories separated by one intermediate 
category are at Distance 2; etc. The most dis- 
similar (distant) two observations coded into 
the Circle can be is then taken to be 8. 

Using this assumption, we may then define 
the “scatter” of the observations coded for an 
individual into the circle to be the average dis- 
tance between all pairs of observations in his 
circle pattern. Furthermore, the dissimilarity 
between two profiles (of Individuals 7 and I/) 
may be taken to be the average distance on the 
circle between pairs of observations belonging 
to different individuals, minus the average dis- 
tance on the circle between pairs of observa- 
tions belonging to the same individual. This 
gives rise to a measure of dissimilarity between 
profiles which can be stated as follows: the 
“Circle-Dissimilarity” of Individuals I and IT 
is given by 


CDi= > (Ker =X m) > d; (Xyn — Mn) 
i z 
where: 


X;r = the proportion of observations for 
Individual J falling into Category i 
the proportion of observations for 
Individual /7 falling into Category i 
X;, = the proportion of Individual Zs ob- 
servations falling into Category j 

the Proportion of observations for 
Individual Z7 falling into Category 5] 
the distance on the Circle between 
= ae i & j (where d;; = dj; 


Xin = 


Xjn = 


dj; = 


This measure is very easily computed for a 
pair of individuals by means of the computing 
sheet (Tables 1 and 2). This includes a table 
with numbers in the body of the table (stand- 
ing for the distances d;;) and with letters 
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THE SENTENCE COMPLETION TEST AS A PREDICTOR 
OF CONTINUATION IN PSYCHOTHERAPY? 


E. WESLEY HILER 
Agnews State Hospital, Agnew, California 


One of the problems with which most men- 
tal hygiene clinics are faced is the premature 
termination of psychotherapy by patients. 
Previously we have reported on differences 
in the Rorschach and Wechsler performances 
between patients who continued and patients 
who discontinued therapy, and our efforts to 
Predict which patients will terminate prema- 
turely (Gibby, Stotsky, Hiler, & Miller, 1954; 
Hiler, 1958b). The present article will deal 
with the sentence completion test performance 
of these criterion groups. 


Method 


The present study was carried out at the 
Veterans Administration Mental Hygiene 
Clinic at Detroit, Michigan. This 


» See a previous 


1This report is based on a dissertation submitted 
to the Department of Psychology at the University 
of Michigan and was carried out at the Veterans 
Administration Mental Hygiene Clinic in Detroit, 
Michigan. 


As in the Rorschach study, we used a 
treme groups for our comparisons. wee, 
who terminated within 5 sessions were a 
sidered to have terminated prematurely Ai 
were compared with patients who remaine E 
treatment for 20 or more sessions. The Pai 
ticular sentence completion test used was di 
Michigan Sentence Completion Test. This e 
consists of 100 items and was developed A 
connection with the assessment of eir 
psychologists (Coplin, 1951; Kelly & Fis ic 
1951) and revised for use with psychiatri 
patients. It is structured with the specific pri 
pose of obtaining information about the ma 
tient’s strongest drives, his principal confi a 
his attitudes toward his parents, sibune 
wife, employer, etc. Many items are desig nis 
to reveal the way the patient deals with a 
aggressive impulses, anxiety, and guilt as Y gs: 
as the intensity and sources of these feelin ‘i 

For the purpose of the present study, <A 
cial scoring Categories were developed a fae 
item by examining the records of an exp ne 
tory sample of remainers and terin a 
(NV = 25). Categories were chosen W as 
seemed to reveal differences between the 
terion groups on this sample. was 

A cross-validation sample (N = 70) nse 
then scored on the basis of these resp i ing 
Categories, The frequency of responses Ery 


it- 
in each category was then tabulated, per” 


ting a chi square comparison between the C 
terion groups for each item of the test. ion 
In an effort to characterize the ine 
Sroups in a more reliable fashion than is P ie 
vided by individual item analysis, 25 ere, 
ality dimensions were selected, each of ” the 
could be evaluated by a series of items 0 the 
Sentence completion test. For instance, ae 
variable “desire for status” all items in W: 
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y 2. 
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the subjects could express their longing for 
success, fame, or wealth were scored 0, +1, 
or +2 on this dimension depending on the 
apparent intensity of their expressed desire. 
The total score on “desire for status” would 
be the sum of the individual item scores on 
that dimension. 

The scoring criteria were developed on a 
logical or a priori basis with the aid of cer- 
tain scales already in existence (Coplin, 1951; 
Forer, 1950; Rohde, 1946; Rotter & Willer- 
man, 1947). The criteria used in scoring each 
item on each variable are fairly objective and 
may be found in the appendix of the doctoral 
dissertation on which this study is based 
(Hiler, 1953). 

A three by two chi square analysis was 

used to compare the criterion groups on each 
of these variables. This method of statistical 
analysis was used since it reveals extremes vs. 
middle position differences as well as high vs. 
low differences between the criterion groups. 
_ A prediction formula was developed using 
items with response categories which discrimi- 
hated the best between the criterion groups on 
the exploratory sample. The formula (Hiler, 
1953, pp. 161-162), which discriminated with 
100% accuracy on the exploratory sample, 
was then cross-validated on our cross-valida- 
tion sample. 

Also, a clinician, experienced in the use of 
the sentence completion test, was given the 
total sample of 95 sentence completion proto- 
Cols, without any other information, and was 
asked to identify the patients whom he 
thought would terminate prematurely on the 
basis of his clinical judgment. 


Results and Discussion 


Out of 100 sentence completion test items, 
15 appeared to discriminate between the cri- 
terion groups beyond the .05 level of con- 


_ fidence as shown in Table 1. 


The differences between the remainers and 
the terminators on these items present a 
fairly consistent picture. One of the main 
findings is the greater willingness to reveal 
Personal feelings and confidential material 
Shown by the patients who remained in treat- 
Ment, This is shown most clearly in items 
dealing with attitudes toward parents and to- 
Ward the self, The patients who subsequently 
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remained in treatment are willing to go into 
detail on these topics, whereas the termina- 
tors often resort to evasive clichés and vague 
overgeneralization. For instance, the remain- 
ers often characterized both parents on Item 
12, whereas the terminators frequently main- 
tained that there was no difference between 
their parents. 

Another characteristic of the remainers 
(related to the above) is their frank admis- 
sion of feelings of inferiority and social in- 
adequacies. Thus, on Item 17, the remainers 
report feeling bad about themselves and their 
personal inadequacies or shortcomings, where- 
as the terminators more often mention such 
things as unfavorable circumstances or “things 
in general.” And on Item 22, the remainers 
mention social inadequacies as causing them 
the greatest amount of trouble in their youth, 
whereas the terminators more frequently men- 
tion acts of delinquency or situational factors. 

A third characteristic of the patients who 
remained in treatment is the tremendous need 
for achievement, success, and status revealed 
in their sentence completion responses. This 
may in part represent an attempt to compen- 
sate for the inferiority feelings mentioned 
above, or it may represent a higher energy 
level and greater determination or drive which 
Barron (1953) has included under the gen- 
eral term “ego strength” and has reported to 
be related with improvement under psycho- 
therapy. This would be consistent with our 
Rorschach findings in which the remainers 
showed greater productivity (Gibby et al., 
1954). 

A fourth characteristic of the remainers is 
their greater psychological sophistication. In 
general, they tend to have more insight into 
psychological causation than do the termi- 
nators. For instance, on 57, more of the re- 
mainers mentioned some form of mental cru- 
elty as being the worst thing a woman can do 
to a man. Likewise on Item 67, some of the 
remainers mentioned psychological forms of 
cruelty, whereas none of the terminators in- 
cluded these, mentioning instead physical acts 
of violence. The remainers also showed greater 
awareness of emotional needs. For instance, 
on Item 34, most of the remainers mentioned 
some real emotional need, whereas many ter- 
minators mentioned such things as baseball, 


i 


£. Wesley Hiler 


Table 1 


Percentage of Responses of Remainers and Terminators Falling in Various Categories on 
Sentence Completion Test Items 


Percentage of Responses 
in Each Category 


ee j 
Termin- 
Remainers ators 
Item Content (N = 41) (N = 29) 
4 People would do anything in order to . . , 
(a) need for status, wealth, or success 83 40 
(b) all other responses .17 60 p = .001* 


5 Ipity... 


(a) people in general j 
(b) people with bad characteristics 15 


15 14 
(c) people with illness or handicaps .22 31 
(d) people in unpleasant circumstances 32 07 
(e) other responses 24 21 pb = 05 
12 The difference between Mom and Dad was . 
(a) both characterized 22 03 
(b) one characterized 24 31 
(c) physical qualities (age, sex) 22 21 
(d) no difference ‘00 28 
(e) other ‘32 17 p = 001 
14 What meant most tome... 
(a) other people 5 
her p -20 36 
(b) being liked or being happy F 4 
(c) other (specific things or events) 56 24 p = .05 
17 I used to feel bad about . . , 
(a) specified other people 
22 10 
(b) myself (personal inadequacies) 49 31 
(© other 29 59 p = 05 
22 Asa youth my Sreatest trouble was . ` 
(a) aggression and delin: 
gress quenc; 
social inadequacies sg R ta 
(3 otie .29 14 
66 59 p= 02 
34 As a youth my greatest emotional need was . . . 
a parental love implied 32 14 
nonemotional need. i 15 j 
ithe S Mentioned 15 38 
54 48 p= 02 
37 A white man who has intercourse with a black woman 
(a) tolerant attitude expressed 
(b) intolerant attitude expressed A a 
(c) nonevaluative statements S o p = .02 
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Table 1 (Continued) 


Item Content 


Percentage of Responses 
in Each Category 


Termin- 
Remainers ators 
(N = 41) (N = 29) 


41 I like people at parties who . . . 


(a) are fun-loving, good mixers 
(b) friendly, kind, courteous 
(c) well behaved, controlled 

(d) other 


55 Love... 


(a) concept described 
(b) favorable attitude expressed 
(c) other 


57 The dirtiest thing a woman can do to a man 5G: s kus 


(a) be unfaithful 
(b) leave him 

(c) mental cruelty 
(d) other 


67 One must never . « - 


(a) kill or injure people 
(b) mental cruelty 

(c) be mad, do wrong 
(d) other 


72 The most significant thing about my school experience . . 


(a) favorable events 
(b) unfavorable events 
(c) neutral 

(d) other 


97 People should tell lies when - - - 


(a) they feel like it (mere volition) 
(b) necessary or no harm done 
(c) never 


100 Authority . . . 


(a) only for those who know how to use it 
(b) unfavorable attitude expressed 
(c) favorable attitude expressed or other 


49 59 
29 07 
07 28 
15 07 p = 02 
37 07 
27 52 
37 4 p=% 
49 62 
15 00 
29 4 
07 24 p= .02 
20 07 
15 00 
12 35 
54 59 p = .02 
24 07 
20 07 
22 48 
34 38 p = .05 
00 17 
73 38 
27 45 p= 01 
39 10 
17 17 
Ad 72 p =.05 


Note.—Percentages are included in this table to facilitate comparisons. . 
* The probability values are based on x? computed from the actual frequencies. 


travel, or education as the greatest emotional 
need in their youth. 

The terminators, in addition to being in 
Zeneral more evasive, stereotyping, and psy- 
Chologically unsophisticated, also contained 
individuals on the extremes of superego domi- 
Nation, Some terminators seem to have a rigid 


superego, which is very intolerant of impulse 
gratification as is manifested in their response 
to Item 41, where many terminators stress 
good behavior and self-control as being of 
primary importance at parties. In contrast to 
these are a group of terminators showing evi- 
dences of psychopathic tendencies. Thus on 
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97, a number of terminators maintained that 
people should tell lies whenever they want to. 
None of the remainers answered in this way. 
Also, many of the terminators Seemed to have 
a history of delinquent behavior, as reflected 
in their answers to Item 22, where a number 
of terminators mentioned aggression or delin- 
quency as the greatest problem of their youth. 

For the results on the scales developed for 
the test as a whole, see Table 2. 

Although almost all the differences between 
the criterion groups are in the direction one 
would expect, only 5 out of the 25 differences 
are great enough to achieve statistical signifi- 
cance beyond the .05 level of confidence. 
Willingness to reveal self on test, feelings of 
inadequacy, desire for status, and objectivity 
are associated with remaining in therapy; 
and evasiveness is associated with premature 


Table 2 


Comparison of Cross-Validation Sample 
Criterion Groups on Sentence 
Completion Variables 


Variable (2 df) Direction p 
Omissions 35 none NS 
Evasiveness 12.73 = 005 
Positive façade 3.38 - -20 
Denials 2.30 = NS 
Positive orientation 4.21 =- .20 
Negative orientation 3.93 TRI 20 
Desire for status 6.14 + .05 
Superego domination 4.05 - 20 
Pleasure domination 1.36 - NS 
Affiliation need 1.02 + NS 
Dependency need 08 none NS 
Passivity in face of aggression 1.93 - NS 
Altruism 4.15 + .20 
Objectivity 7.20 + -025 
Depression 4.10 É 20 
Paranoid feelings 26 none NS 
Overt hostility 22) none NS 
Somatic preoccupation 3.93 = 20 
Feelings of inadequacy 12.26 + ‘005 
Motivation for recovery 3.77 sfo "20 
Complexity of response 2.99 a NS 
Willingness to reveal self 14.37 + 001 
Bizarreness 4.75 =- 10 
Silliness 51 _ NS 
Reference to alcoholism 3.00 - NS 


Note.— + Variable shows positive relation to continuance; 
— Variable shows negative relation to continuance T Re. 
mainers occupy intermediate position; NS Not significant even 
at .20 level. 


termination of therapy. These results are Fe 
Consistent with our previous discussion on al 
individual item findings. Note that nen ' 
practically no difference between the pe a 
ers and terminator on items omitted an oi 
our measures of dependency need, paran 
tendencies, and overt hostility. À 
The prediction formula developed a i 
exploratory sample discriminated berea 
criterion groups with 71% accuracy © ately | 
cross-validation sample. This is approxi? ve 
the same as our best Rorschach (687 ecu 
curacy) and Wechsler-Bellevue (657% Hiler, 
racy) predictors (Gibby et al., 1954; nite 
1958b) and may be near the mane 
gree of accuracy possible when the pre vith- 
is based on the records of patients alone von 
out consideration of the therapist’s ee edic 
ality and competence in making the Piper | 
tion. It has been found that different pjer 
pists lose different types of patients ; 
1958a). : pal 
mig clinician, using his intuitive a oni 
judgment rather than a prediction fo This 
achieved 68% accuracy of predio enh the 
figure is not much below that obtaine ntenc 
sign approach and suggests that the a hi 
completion test, perhaps because of iy ac 
degree of face validity, can yield fai tuiti 
curate predictions even when the in 
method of clinical judgment is used. Aig sen^ 
Tt is the opinion of the author that e of the 
tence completion test is potentially on nts for 
most useful devices for selecting par ie 
Psychotherapy. It seems to have conien A 
face validity, for it permits fairly ainic? 
predictions on the basis of intuitive pelt 
judgment. This makes it especially su ise 
the many clinicians who prefer the in a 
clinical judgment over the actuarial me 
proach. The sentence completion a 
to permit inferences about many asp! te 0% 
the patient’s personality which are rela cou 
his behavior in psychotherapy. Items yari 
be especially designed to measure the on Í 
ables found to be related to contints 
Psychotherapy and other variables, ee 
empirical or theoretical grounds, one weve 
hypothesize to be related to the pa cho 
ability to enter into and profit from a psy" n 
therapeutic relationship. 


A 


Sentence Completion Test in Psychotherapy 


Summary 


Sentence completion responses of patients 
who remained in treatment for at least 20 
sessions were compared with the responses of 
patients who terminated within 5 sessions. 

Significant differences were found between 
these groups. Patients who subsequently re- 
mained in treatment tended to be: 

1. Less evasive and more willing to reveal 
personal feelings and confidential material 
about themselves and their parents. 

2. More preoccupied with feelings of per- 
sonal and social inadequacy. 

3. More driven by needs for achievement, 
Success, and status. 

4. More aware of emotional needs and in 
general showing greater psychological so- 
Phistication. 

Patients who terminated included a number 
With overly rigid superegos as well as a num- 
ber of individuals with rather weak superegos. 

A prediction formula was developed on an 
exploratory sample which permitted 71% ac- 
Curacy of prediction on a cross-validation 
Sample, 

A clinician using the intuitive method of 
Clinical judgment predicted the criterion with 
68% accuracy. 
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A FACTOR STUDY OF THE MMPI PSYCHOPATHIC 
DEVIATE SCALE 


ALEXANDER W. ASTIN 


United States Public Health 


The clinical diagnostic term “psychopathy” 
has been the target of extensive criticism dur- 
ing recent years. Its supposed ambiguity 
(Cameron & Magaret, 1951), among other 
things, has been one of the Principal features 
which has stimulated comment. Indeed, the 
authors of the MMPI + Psychopathic Deviate 
(Pd) scale early recognized the empirical 
multidimensionality of the Psychopath con- 
cept (McKinley & Hathaway, 1956). 

Extended use by the author of the MMPI 
with a population of hospitalized drug addicts 
led to the impression that equally high Pd 
scores can be obtained by vastly different 
types of “psychopaths.” The present study 
grew out of these experiences and was con- 
cerned primarily with two problems: (a) 
identifying, by means of a factor analysis of 
the MMPI Pd scale, some of the traits which 
characterize people labeled psychopathic de- 
viates; and (b) demonstrating that identical 
Pd scores can have quite different clinical im- 
plications, depending upon the composition of 
the internal factors contributing to the total 


Pd score. 
Subjects 


Cotic addicts ? from the 
U. S. Public Health Servi 


» including 
» Were used in the second 
of the Ss 
he Ss be- 
aw scores 


was 19-61, w 
tween ages 20 and 35. Ss whose r: 

1 Minnesota Multiphasic Personalit: 
(Hathaway & McKinley, 1951). 


? These Ss were not currently addicted and were 


recovered from the debilitating effects of opiate 
withdrawal. 


y Inventory 
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Service Hospital, Lexington, Kentucky 


s 
on the MMPI F scale surpassed 15 nee 
carded and replaced by Ss with valid P t thi 
The mean Pd T score for male adie pial 
hospital is 75, and approximately 60 “a 
their highest MMPI score on this pe Tower 
than 15% obtain Pd scores eet scales: 
than third among the nine clinica on thi 
However, the variability of the adc ae À 
scale is comparable to that of normals 
ard deviation = 10.6 T score points). 


Method 


+. pole 
The method used in the factor ae ised 
tion of this study was identical to 957) w 
by O’Conner, Stefic, and Gresock (19: a scale: 
recently factored the MMPI Deprea valid 
Using the sample of 250 addicts v eficient® 
profiles, tetrachoric correlation ae item’ 
were computed among the 50 Pd sca than 19 
Items with response frequencies ee reducile 
or greater than 90% were discarded, matí 
the Pd item total to 49. The renina 
of 1,176 intercorrelations was subla 


multiple-group factor analysis. plis 


oblique, simple mupe ya accom i 
by the single plane method. 4 tw 

| thas te a had been identified i thar 
attempts were made to demon mael jca! | 
identical Pd scores can have diterna gP w 
implications. The first involved loca coul 

of depressed and nondepressed Ss x corte h 
be matched on both Pd and its k o5. 

tion. Depressed Ss were defined 3 cot? | 
having the MMPI D (Depression 
above T = 75; nondepressed Ss ve a non 
with D below T = 57. A depressed an if 
depressed § were considered matche A ea 
Pd and K, respectively, of one S We P 


ped 


: thi 
that 4K is normally included as part of 


essary? A 
i c 
® Matching on K was also considered ne ta 
Pd score. 


Factor Study of Psychopathic Deviate Scale 


Table 1 
Rotated Factor Matrix 
Pdltems I I w w v 

1 —.30 08 20 01 23 
2 —.35 21 00° =i 22 
3 —.07 3L —.15 10 35 
4 — 45 20 05 —.38 29 
5 —.05 69 —11 —.08 25 
6 =g 26 18 —.10 12 
; =—.32 07 02 —.71 19 
9 06 —.01 —.18 01 01 
10 =05 =.09 73 —.05 22 
11 .05 33 33 10 04 
12 — 41 21 17 —.09 18 
13 —.65 21 22 —.05 38 
14 13 —34 AT 08  —.17 
15 =.21 19 17 —.22 05 
16 —.28 16 06 —.05 55 
17 ~.54 28 28  —.09 30 
18 =% 28 09 lS 33 
19 —.66 08 29 —A7 = —.03 
20 —.66 35 =00 —10 22 
21 = 27, 26 03 22 35 
22 =10 68 30 —11 06 
23 =.02 08 72 —.14 00 
24 05 04 2i =07 —.36 
25 35 —08 —:28 36 —.10 
26 —.20 26 13 22 63 
27 25 —43 —.26 06 —.02 
28 -07 11 16 .08 AS 
29 —.36 06 05 07 63 
30 62 —.05 —.02 15 —.23 
31 —.34 .29 74 17 18 
32 70 —.26 —.05 05 —.34 
33 eit 03 10 35 —.02 
34 ‘56, —:27 09 29 —:39 
35 —.20 09 AL = —.03 03 
36 =o! 04 —.09 —.23 68 
37 S26 .28 4 —.21 —06 
38 aj, 05 —.17 57  —08 
39 —.24 01 0s =81 =0 
40 02 20 02 —.01 13 
41 —.34 15 01 —.26 27 
42 —.29 39 ‘28 —A5 —.03 
43 —.32 19 .27 —.07 04 
44 or —28 ~=105 50 32 
45 66 —44 —01 18 —.17 
46 —.28 59 06 —.25 —.03 
47 =—07 —.03 08 48 17 
48 DA ESY 25 21 08 
49 —.07 —.14 42 02 —.09 
50 OY -03 = 67 01 


^ Items are numbered in order of their appearance in the 
nventory. 


within one raw score point of the Pd and K 
of the other S. Twenty-one such matched 
Pairs were collected. Mean differences between 
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depressives and nondepressives on each of the 
Pd factors were tested for significance by 
means of ¢ tests for matched samples (df = 
20). 

The final comparison attempted to relate 
Pd factor differences to a non-MMPI vari- 
able. Twenty-three physician addicts were 
matched with 23 nonphysician addicts on Pd 
and K (as above). ¢ tests for matched sam- 
ples (df = 22) were used to test differences 
between physicians and nonphysicians on 
each of the Pd factors. 


Results and Discussion 


Five identifiable factors emerged from the 
analysis of Pd item intercorrelations.* Ro- 
tated loadings of the 49 items on each factor 
are presented in Table 1. 

Sixty-two per cent of the 1,176 residuals 
fell between =.09, inclusively, and 91% fell 
within +.19. Since close inspection of the 
larger residuals did not reveal any meaning- 
ful clusters involving more than two items, 
no further factors were extracted. Several of 
the obtained communalities differed markedly 
from the initial estimates, as indicated by an 
r of only .58 between the two sets of esti- 
mates. The larger discrepancies tended to in- 
volve items with extreme response frequencies, 
where initial estimates of communalities (cen- 
troid method) often appeared to have been 
based on spuriously high intercorrelations. 

Each of the five factors, together with items 
containing the highest loadings, will be pre- 
sented and discussed separately. 


Factor I: Self-Esteem 


Item 


T find it hard to make talk when 
I meet new people. (F) 


. When in a group of people I 
have trouble thinking of the 
right things to talk about. (F) 


Oblique Loadingë 


32. 
-70 


.66 


. Much of the time I feel as if I 
have done something wrong or 
evil. —.66 

4 Copies of the correlation matrix may be obtained 
from the American Documentation Institute. Order 

Document No. 6066, remitting $1.25 for microfilm 

or $1.25 for photocopies. 

5 When scored in the keyed (i.e, Pd) direction. 
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Item Oblique Loading® 
19. My hardest battles are with 
myself. (T) —.66 
13. I wish I could be as happy as 
others seem to be. (T) =.65 
30. It makes me uncomfortable to 
put on a stunt at a party even 
when others are doing the same 
sort of things. (F) 62 
34. I wish I were not so shy. (F) 56 
17. I do many things which I re- 
gret afterwards (I regret things 
more or more often than others 
seem to). (T) — 54 
4. At times I have very much 
wanted to leave home, (T) — 45 
12. I have not lived the right kind 
of life. (T) —AL 


The positive pole of this factor (Items 30, 32, 
34, 45) consists of statements denying social 
introversion and shyness; the negative pole 


) contains state- 
nd guilt feelings. 
semble the two 
viates cited by 
, Pp. 198-206). 
These authors describe the “inadequate” (low 
as one who fails 


one who partially rec- 
€quacies and therefore 


a bipolar factor should 
Clinical scale is some- 


Means that persons who 
© one pole in the P, 


to respond to the 
Pd directi 


scale designed to meas 
however heterogeneous, 
contain mutually exclusiy 


Alexander W. Astin 


Factor IT: Hypersensitivity 


Oblique l 


Item 
5. No one seems to understand me. 
(1) 63 
22. Someone hasit in for me. (T) 68 


46. Iam sureIam being talked 59 
about. (T) G 

20. Much of the time I feel as if I 
have done something wrong or 
evil. (T) 

45. When in a group of people I have 
trouble thinking of the right 
things to talk about. (F) 


27. My conduct is largely controlled 
by the customs of those about 
me. (F) 


42. My way of doing things is apt to 
be misunderstood by others. 
(T) 39 


Pe (i)! 
This factor appears to be a combination © 
extreme sensitivity in interpersonal a 
guilt, and ideas of reference. Such a sae. 
suggests the clinical picture of mild para 


Factor IIT: Social Maladaplation 


Then Oblique Loading 


31. I liked school. 
10. During one period when I was a 


youngster I engaged in petty 73 
thievery. (T) s 


«) a 


23. At school I was sometimes sent 
to the principal for cutting up. 


(T) 72 
49. Ihave never been in trouble with 42 
the law. (F) i 


37.§My parents have often objected 
to the kind of people I went 


1 
around with. (T) 4 


a con 
This is perhaps the only factor which Ai 


forms well to a commonly held sterea e 
psychopathy, that is, antisocial or s0 


havior. 


Factor IV: Impulse Control ain’ 
Oblique L0? 


Item 
7. I have had very peculiar and -ii 
strange experiences. (T) 
50. I have periods in which I feel i 
unusually cheerful without any 67 | 


special reason, (F) 


A, 


h 


Factor Study of Psychopathic Deviate Scale 


Item 


38. I like to talk about sex. 57 


(F) 
44. Sometimes without any reason 
or even when things are going 
wrong I feel excitedly happy, 
“on top of the world.” (F) .50 


47. L have very few fears compared 
to my friends. (F) AS 


42. My way of doing things is apt to 


be misunderstood by others. (T) —A5 
4. At times I have very much 

wanted to leave home. (T) —.38 
25. At times my thoughts have raced 

ahead faster than I could speak 

them. (£) 36 


The positive pole of this factor (Items 25, 38, 
44, 47, 50) suggests a lack of spontaniety in 
feeling and action. The negative pole (Items 
4, 7, 42), conversely, indicates a loosening of 
impulse controls. 


Factor V: Emotional Deprivation 


Item Oblique Loading 


36. There is very little love and 
companionship in my family as 
compared to other homes. (T) 68 
29. What others think of me does 
not bother me. (F) .63 


26. Ibelieve my home life is as pleas- 
ant as that of most people I 
F 


know. -63 
16. I do not mind being made fun of. 
F. 55 
34. I wish I were not so shy. (F) —.39 
13. I wish I could be as happy as 
others seem to be. (T) 38 


These items suggest a need for, and also a 
feeling of having been deprived of, emotional 
support. 

In general, these five factors support some 
of the rational groupings of items previously 
noted by McKinley and Hathaway (1956) in 
their description of the construction of the 
Pd scale: “tendency to respond in overper- 
fect ways” (positive pole of Factor D “de 
pression and absence of strongly pleasant ex- 
Periences” (negative pole of Factor I and pos- 
sibly Factor V); “paranoid trends” (Factor 
IL); and “social trouble” (Factor IIT). It is 
Significant that the “family trouble” cluster 


Oblique Loading 
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Table 2 
Correlations Among the Primary Axes 
I IL Ul IV v 

I —.12 
I —.17 .10 

IV .22 —.09 —.22 

Vv —.56 .09 —.04 12 


noted by McKinley and Hathaway did not 
appear as a unitary factor. On the contrary, 
items relating to conflict with the family 
(Table 1, Items 4, 11, 18, 26, 36, 37, 39, 43) 
were well scattered among the several factors. 
This would suggest that the complexity of 
family relationships precludes evaluating them 
on a simple good—bad or trouble-harmony 
continuum. 

Table 2 shows the correlations among the 
primary axes. The largest correlations tend 
to occur mainly with Factor I (Self-Esteem) 
and are consistent with the interpretations of 
the factors. For example, low Self-Esteem 
people will tend toward Hypersensitivity, 
Emotional Deprivation, Social Maladaptation, 
and low Impulse Control. 

Factor scores for each S were obtained by 
summing the number of high-loading items ° 
on each factor which were answered in the 
keyed (Pd) direction. (Items with negative 
loadings were scored in reverse.) Table 3 shows 
the Pearson correlations between these scores 
and the MMPI K scale for a random sample 
of 50 addicts. Factor items which overlap 
with K have been eliminated in computing 
these correlations, thereby reducing Factors I, 
II, IV, and V to seven, six, five, and five 
items, respectively. Apparently K serves as a 
significant suppressor on each of the factors. 
Its action on the two bipolars (I and IV), 
however, is to suppress the negative pole. It 
may well be that a good deal of the covari- 
ance in Table 2 can be attributed to the op- 
eration of K. 

The factor scores used in comparing de- 
pressed and nondepressed addicts were com- 
puted in the following manner: all Pd factor 
items which overlapped with the D scale were 


6 Items which are listed under each of the factors 
(above). 
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initially given a Draw-A-Man IQ by entering the 
mental age derived from the drawing into the 1937 
Stanford-Binet tables (Method A). Next, for Ss 
older than 13.0 years, a second IQ was computed 
by dividing S’s MA by Goodenough’s recommended 
maximum CA of 13.0 (Method B). For children 
under 13 years of age, Goodenough agrees with Ter- 
man and Merrill in dividing MA by actual CA, so 
Methods A and B are identical, 

Ss were divided first into two main groups on the 
basis of degree of retardation (mild or moderate) as 
determined by previous individual intelligence tests, 
Within the major groups, individuals were next clas- 
sified according to chronological age into eight sub- 
groups. All of the subgroups within each major cate- 
gory were found to be well matched in original IQ, 


Results 


The analysis of the data preceeded in two 
general steps, corresponding to the two ques- 
tions to be answered, 


Mental Age 


Question 1 inquiries whether Draw-A-Man 
MA continues to increase after 13.0 years. 
To answer this question it is necessary to ob- 
tain the mean raw score at each of the eight 
CA levels. As shown in Table 1, the m 
scores and the MA 
tinue to increase 


contrary 
implied when a 


Mitchell for this assi 
drawings by the write 
relation between scori 


stance, Rescoring of the 100 
r after one year showed a cor- 
ing and Tescoring of .96, 


Anna Carr Mitchell 


Table 1 


Mean Performance on the Draw-A-Man Test 
at Various Chronological Ages 


Moderately Retarded Mildly Retarded 


Age N Score MA N Score MA 
9% 22 44 411 22 1122 58l 
l0 31 700 475 35 13.01 oe 
11 24 10.00 550 34 14.73 X ji 
12 35 10.51 563 46 1734 1734 
J3 38 1159 590 42 1862 76 
1i 24 1230 6.10 62 1992 T9 
15 32 13.77 644 48 2286 Ho 
l6 14 134i 635 27 2253 8 
* Includes Ss age 9-0 to 9-11, 


is significant at the .01 level (t= 7.58) 
mildly retarded and at the .02 level (é 
2.38) for moderately retarded. +g. 
One aspect of these results is penplena 
A consistent finding in regard to growt how 
mental age is that persons age 16 BE. 
slightly greater mental maturity than perns 
age 15. The Binet norms allow four r P 
of MA growth for the CA period from y, 
to 16.0 in the normal child. Yet, in this a ai 
16-year-olds do no better than 15yo n 
A clue may be provided by the reduced P jn- 
ber of Ss at age 16. Contact with sever ate 
stitutions for the mentally retarded indioa 
that, due to crowded conditions, the P pelore 
retarded child completes his schooling . ra 
age 16. Children retained in school jecte 
extra year would then constitute a se pro" 
sample, possibly composed of persons se 
gressing more slowly academically becau 
social or emotional immaturity (White, 4 We 
The relationship between lowered D ajust- 
Man performance and emotional me 
ment or immaturity is well documented n i 
literature, and finds widespread applicat t 
the Machover (1949) Draw-A-Person té : 
Seems probable that the present mek - 
age 16 should not be considered represe” = 


tive of mentally retarded persons in 8° 
of that age. 


IQ 


im 

Although raw score has been shown mast 

crease significantly after Goodenough’s i of 

mum CA divisor of 13.0, such a pee 
little importance unless it can also be $ 


4 ee ee ee eee 


o 


New Maximum CA for the Draw-A-Man Test 


Table 2 


Mean IQs on the Draw-A-Man Test at Different 
Age Levels, Computed by Two Methods 


Moderately Mildly 
Retarded Retarded 
Age A B A B 

9 42.22 60.93 
10 45.70 59.66 
11 46.74 57.66 
12 44.98 59.08 
13 45.08 45.74 59.23 60.77 
14 43.39 46.78 57.28 61.30 
15 43.96 49.89 59.47 67.14 
16 42.21 49.16 57.86 66.64 


that such increment is sufficient to appreciably 
raise the IQ. To answer this question, mean 
IQ’s by Methods A and B have been calcu- 
lated at all CA levels and appear in Table 2. 
It is assumed here that, ideally, IQs would 
remain constant over the entire CA range 
and, furthermore, that CA groups, similar in 
intelligence, constitute equivalent proxies for 
a single group of people examined at succes- 
sive CA levels. Table 2 shows that Method A 
yields about the same mean IQs at all CA 
levels in the mildly retarded group. There ap- 
pears to be a slight decline in IQ after age 
14.0 in moderately retarded; however, per- 
sons age 16 achieve about the same, and per- 
sons age 14 and 15 do better than persons 
age 9. On the other hand, Method B allows 
a gradual increase in mean IQ after age 12 
in both groups. 

To determine the significance of these 
trends, all children in each major group be- 
low CA 13.0 were combined into a single large 
subgroup, characterized by Draw-A-Man IQs 
identical whether computed by Method A or 
B. This large subgroup would constitute a 
control, the performance of which should be 
approximated closely by groups of older Ss 
similar in individual test IQ. This large sub- 
group is compared with Ss aged 15.0 to 16.9. 
Results suggest that Method A is superior to 
Method B for the present sample. Method B 
allows an average increase of 4.25 IQ points 
for moderately retarded and 7.58 points for 
mildly retarded patients from age below 13.0 
to age 15.8. In fact, Method B shows about 
half of the present moderately retarded sam- 
ple age 15 and 16 scoring in the mildly re- 
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tarded range, a situation clearly out of line 
with their intellectual capacities as measured 
by individual intelligence tests. In Method B, 
differences between the means are significant 
(for moderately retarded ¢ = 2.28, P< .02, 
for mildly retarded t= 4.92, P< 01). No 
significant change in mean IQ is found be- 
tween Ss younger than 13.0 and Ss older than 
14.9 when Method A is employed (t= .49 
for moderately retarded and .99 for mildly 
retarded). 
Summary 


This study attempts to determine an ap- 
propriate maximum CA divisor for the Draw- 
‘A-Man test. The sample consisted of 536 
mentally retarded children, grouped into eight 
age levels from 9 to 16 years. 

The children in the present sample were 
found to show growth in Draw-A-Man men- 
tal age through at least the sixteenth year. 
When IQ was computed using the recom- 
mended maximum CA divisor of 13.0, the 
growth in MA after age 13.0 resulted in sig- 
nificant, spurious increases in IQ. When the 
maximum CA divisor was placed at a higher 
age level, IQ remained constant over the en- 
tire CA range tested. 

The results indicate that a maximum CA 
divisor of 13.0 is inappropriate in calculating 
Draw-A-Man IQ; the significant MA incre- 
ment after age 13.0 should be counterbalanced 
by a corresponding CA increment. An appro- 
priate pattern for CA increase through the 
years from 13 to 16 was found to be that 
used by Terman and Merrill in constructing 
the Stanford-Binet IQ tables. 
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A NOTE ON “SOCIAL DESIRABILITY AS A VARI- 
ABLE IN THE EDWARDS PERSONAL 
PREFERENCE SCHEDULE” 


ALLEN L. EDWARDS, CALVIN 


E. WRIGHT, anp CLIFFORD E. LUNNEBORG 


University of Washington 


The Edwards Personal Preference Schedule 
(EPPS) is a forced-choice inventory in which, 
with standard instructions, subjects are asked 
to describe themselves by choosing between 
AB pairs of personality statements. 

A group of 134 psychology students at the 
University of Washington was given the com- 
plete EPPS with standard instructions to de- 
scribe themselves. Another Sroup of 114 stu- 
dents was given the complete EPPS with 
instructions to choose the alternative they 
considered to be more socially desirable. A 
third group consisted of a sample of 160 rec- 
ords drawn from the normative group used in 
standardizing the EPPS, These three groups 
will be referred to as the W, SD, and N 
Sroups, respectively, 

For each group, the proportion giving the 
A response to each of the pairs of statements 


was found Separately for males and females. 
These proportions we 
vide estimates of thos 


e 
To determine the similarity between t 
item statistics for the W and N groon cor- 
proportions choosing A in each item we cen 
related. For the complete set of 210 use 
the correlation was .93. For the 30 aa 91. 
in the Buffalo study, the correlation be 
We then found the correlation beta 0 
item statistics of the SD group and t set 0 
the W and N groups. For the complete dól 
210 items these correlations were .69 io item 
respectively. For the selected set of Jations 
used in the Buffalo study, the two corre 
were .64 and .51, respectively. icon 
The results reported above are a study- 
ent with those obtained in the Buffa ° 38 was 
In the Buffalo study, a correlation of z A un- 
found between the proportions alana TAA 
der standard instructions and under able ak- 
tions to choose the more socially der ka 
ternative for the selected set of 30 sptaine 
the other hand, the correlations we % be- 
for the same set of 30 items were “sp and 
tween SD and W) and .51 (between that iP 
N). The two investigations differ E bo 
the Buffalo study, the 30 items were, f con- 
sets of instructions, administered out Ke 
text, whereas in our study they were 2 pasizê, 
The results we obtained serve to eae from 
once again, the fact that removing ite™ alter 
the context of a standardized test ma pemi 
the nature of the items and responses t0 


sist- 
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Hanvik (1954) has reported that 80% of chil- 
dren who rotated one or more Bender figures had 
abnormal EEGs. He concludes that “the rotation 
of the figures of the Bender-Gestalt test is even 
more highly predictive of brain damage in chil- 
dren than among adult patients” (p. 399). 

Li, Our purpose was to follow up Hanvik’s sug- 

gestive findings with children, since he presents 

no control data nor makes reference to the ante- 
cedent probability of abnormal EEGs in his 
opulation. 

Our population consisted of 68 children, both 
male and female, under the age of 18, in a resi- 
dential treatment center. 

The Ss were’ selected, having met two criteria: 
(a) an EEG examination and (b) a scorable 
Bender-Gestalt protocol. The Bender is adminis- 
tered routinely, but EEGs were available only if 
there had been medical indication for this pro- 
cedure. Hanvik does not indicate whether Ben- 
ders and EEGs are administered routinely in his 
clinic. 

The Bender-Gestalt records were scored for ro- 
tations of 30° or more from the normal axis, fol- 
lowing Hanvik and Anderson (1950). Of those 
children who had one or more Bender rotations 
(N = 51), 69% had abnormal EEGs. This ap- 
Proaches Hanvik’s findings of 80%. Of those with 
no rotation (N =47), only 47% had abnormal 
EEGs. This difference is significant (p = .05). 

The probability of obtaining an abnormal EEG 
in our sample is 63%. Using the presence or ab- 

«sence of one or more Bender rotations as a pre- 

dictor of abnormal EEGs, we could make the 

Correct decision in 65% of the cases. Using 


, (MAn extended report of this study may be ob- 
tained without charge from Sherwood B. Chorost, 
evereux Schools, Devon, Pa., or for a fee from the 

American Documentation Ins itute. Order Document 

No. 6021, remitting $1.25 for microfilm or $1.25 for 

s Photocopies. 
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BENDER-GESTALT ROTATIONS AND EEG ABNORMALITIES 
IN CHILDREN? 


SHERWOOD B. CHOROST, GEORGE SPIVACK, axb MURRAY LEVINE 


Devereux Foundation, Devon, Pennsylvania 


Bender rotations does not increase our predic- 
tive efficiency. 

Hanvik’s (1954) conclusion that Bender rota- 
tions are highly diagnostic of brain damage in 
children is supported neither by his study nor by 
ours. He reports neither base rates of EEG ab- 
normality nor the frequency of predictive fail- 
ures which would enable us to evaluate the diag- 
nostic efficiency. Hanvik did not report on the 
number of cases that had no rotation and that 
also had EEG abnormality. Unless EEGs are 
given routinely, the frequency of EEG abnormali- 
ties is likely to be very high, and the correlation 
he reports could reflect this. 

Our data point up the importance of assessing 
the diagnostic utility of any clinical tool against 
some known base rate. However, there is an im- 
portant distinction to be drawn between diag- 
nostic efficiency and scientific validity. If the 
EEG criterion of brain damage has some va- 
lidity despite all the recognized weaknesses, in- 
dividuals who do rotate Bender designs are more 
likely to have brain damage than those who do 
not rotate. We cannot use this fact diagnostically 
with any efficiency. However, lest our newly 
found understanding of the base rate problem 
in diagnosis discourage us, it should be pointed 
out that the obtained results are still meaningful 
in helping us to note some of the perceptual and 
psychomotor consequences of brain damage. 
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EYE-EAR EMPHASIS IN THE DAP AS INDICATING 
IDEAS OF REFERENCE? 


ALBERT V. GRIFFITH anp D. A. R. PEYMAN 2 


Bryce Hospital, Tuscaloosa, Alabama 


The purpose of this study was to relate eye- 
ear emphasis in the DAP with the trait, “ideas 
of reference.” The Ss were drawn from 745 male 
patients who had consecutively entered Bryce 
Hospital. The DAP drawings of this population 
were jointly scanned by two staff psychologists, 
Eighteen Ss were selected as emphasizing eyes 
and/or ears. Only those Ss were selected when 
both judges were in agreement as to the presence 
of the sign. A conservative Position was taken; 
i.e., only those Ss were chosen where eye and/or 
ear emphasis was obvious, An 8% sample (N = 
58), which was to serve as the control group, 


was then randomly selected from the remaining 
population, 


were not based on any Psychometric data. As the 
two judges worked together, no estimate of reli- 
ability was made. B 
much easier to judg 
reference than to decide in w 


1An extended report of th 
tained without charge from D, A.R. P 
chology Department, 


eyman, Psy- 
Tuscaloosa, Alabama, 


Station 3, 
the Ameri- 


een 

cated that a significant difference existed pee, 
the two groups (y? = 7.754 for one af; P firmed: 
It is concluded that the hypothesis is con t the 

Swensen’s judgment (1957, p. 461) tin 
DAP is of use in clinical work only as a t 
Screening device was based on studies nee. jes | 
certain defects of design. Most of these $ 
used psychiatric diagnoses as the coe as 
reliability of psychiatric diagnoses, howeve diag- 
been questioned for years. If payone cii 
nosis (paranoid involvement) had been 4 results | 
terion in the present study, nonsignifican 18 
Would have been obtained. Only 5 of the E 
in the eye-ear emphasis group were diagno 
having paranoid involvement, while 8 Ss 
control group were so diagnosed. studies 

What was being tested in most of the ay 
reviewed by Swensen was the omeia T, 
signs in predicting various psychiatric la 
most important thing for the clinician, 
is the validity of the sign; i.e., when t È 
present, does it signify beyond chance pa wi 
a given condition or trait. The present ise 9 
designed to investigate this type of pro p was 
result was that eye-ear emphasis in the f refer 
demonstrated to be predictive of ideas © 
ence. js in the 
Our data indicate that eye-ear eon j 
DAP, while valid, is inefficient in predicti as it i 
of reference. This should not surprise eficient ip 
generally recognized that tests are ineffl 
predicting Personality variables. 


he sigh 
ctane 
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THE VALIDITY OF THE COLUMBIA MENTAL 
MATURITY SCALE? 


BETSY WORTH ESTES, FRANK KODMAN, anp MACY AKEL 


University of Kentucky 


Previous studies of the 1954 Columbia Mental 
Maturity Scale (CMMS) indicate that further 
investigation is warranted before uncritical use is 
made of it with motor damaged and/or verbally 
handicapped children, The present study uses the 
Wechsler Intelligence Scale for Children (WISC) 
as the criterion. 

The test sample consisted of 25 male and 25 
female elementary school children in a middle- 


“ class suburban school in Kentucky. The age range 


was 7-2 to 9-4 years with a mean age of 8-2 
years. The study was designed so that the sample 
would have a mean and standard deviation which 
would not differ from the CMMS standardization 
group for ages seven, eight, and nine years (Akel, 
1958). The obtained ¢ between the present sam- 
ple and the standardizing sample equalled 1.05, 
with 98 df. An F test indicated that the vari- 
ances were homogeneous. Further details may be 
found in Akel (1958). 

The CMMS was correlated with the WISC 
Full Scale (FS), Verbal Scale (VS), Perform- 
ance Scale (PS), and the WISC subtests. A cor- 
relation matrix was constructed, and Osgood and 
Suci’s method of factor analysis was used (1955). 


1An extended report of this study may be ob- 
tained without charge from Frank Kodman, Jr. or 
Betsy Worth Estes, Department of Psychology, Uni- 
Versity of Kentucky, Lexington, Kentucky, or for a 
fee from the American Documentation Institute. Or- 
der Document No. 6020, remitting $1.25 for micro- 
film or $1.25 for photocopies, 


Coeflicients of correlation between the CMMS 
and WISC FS, VS, and PS, respectively, were 
49, .53, .36. Correlations between CMMS and 
WISC subtests ranged from .05 to .51. Thus the 
correlations range from very low to moderate 
only. The use of Fisher’s z transformation dem- 
onstrated that the only correlation which differed 
significantly from that of the CMMS and WISC 
FS was Picture Completion. 

Factor analysis of the correlation matrix indi- 
cated five factors. All tests were loaded on Fac- 
tor I, which may represent general intelligence. 
The other four factors were specific to certain 
subtests: Factor II, Object Assembly; III, the 
CMMS and Picture Completion; IV, Coding 
and Picture Arrangement; and V, Similarities. A 
larger sample is needed to assess the validity of 
the factor loadings. 

The validity of the CMMS is not upheld by 
the present study. The CMMS should not be 
used as a substitute for intelligence tests other 
than the Stanford-Binet, although it may have 
limited use when other tests cannot be used. 
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PERSONALITY FACTORS IN 
AS DERIVED FROM 


DONALD R. PETERSON 


This study is part of a larger research Program 
designed to provide descriptive info 
personality structure j 
(Cattell, 1957). Cross. 


sonality at several d 
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Coperative Nurse: School. 
Urbana, for their he re i 
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NURSERY SCHOOL CHILDREN 
TEACHER RATINGS»? 


AnD RAYMOND B. CATTELL 
University of Illinois 


ogy, C, H, E, G, K, F, I, L, and A) were ica 
fied with reasonable confidence. Four others ‘A re 
tentatively identified as D, J, M, and O. oi 
cently stated proposition (Cattell, 1957) A aa 
Structure of personality undergoes no i and 
change during childhood was thus confirme! 
the finding extended to early childhood. A 
Although the same factors evidently ae 
throughout the age range examined in the 
of investigations A 
factor cont sometimes appeared to chans 


ed 


ness to Neuroticism vs, Ego Strength (Ca 
hibits a developmental change from u 


cated emotional instability and sensitivity 1 
childhood, 
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New Tests 


Weingarten, Kurt P. Picture Interest Inventory, 
Grades 7 to adult, Untimed, (35) min. Test book- 
let; answer sheets; scoring keys; manual; pp. 24. 
Los Angeles: California Test Bureau, 1958. 


The Picture Interest Inventory (PII) makes use of 
fmplified line drawings of men engaged in occupa- 
tonal activities. It consists of two parts: Part I con- 
tains 53 groups of three pictures each to which the 
Subject responds by choosing the represented activity 
e likes the most and the least; Part II consists of 
30 additional pictures each of which is responded 
© separately. Six occupational scores (Interpersonal 
Service, Natural, Mechanical, Business, Esthetic, Sci- 
entific) and three nonoccupational (Verbal, Compu- 
tational, Time perspective) are obtained. 
hough it rests on a number of studies, only a 
ie has been made on the development of this test. 
3 orms are based on 1,000 males, drawn in unspeci- 
ied portions from junior high school, high school, 
pod college, and on 140 females (66 12th graders and 
ke SaN graders), the latter set being anchored to 
The ms n the Occupational Interest Inventory. 
o manual reports that norms for different age 
all ups (males) were within two raw score points in 
ei of the distribution for seven of the nine 
ah S and the other two differed by three points in 
Rew points of their respective distributions. 
a Ae 4s given for judging comparability of age 
* = es with respect to such factors as intelligence 
abie ects or the social class of their parents. Reli- 
Rai i are based on test-retest with one week in- 
The, and are acceptable, though not outstanding. 
P claim for the test’s validity rests on sub- 
ee Correlations with appropriate scale of the 
has Pational Interest Inventory, moderate correla- 
wee the Kuder Preference Record, and highly 
Blank Correlations with the Vocational Interest 
theg The only reported study of females reveals 
eee cence of distinct sex differences. Though much 
asis is placed on the test’s nonverbal character 
k i X consequently greater applicability to 7th 
iE S, neither longitudinal data nor data comparing 
ectiveness with verbal tests are provided. 


si 


PSYCHOLOGICAL 
TEST \RE 


IEWS 


This may prove to be a very useful addition to 
the kit of vocational interest tests. Much more work 
needs to be done before it can be accepted with con- 
fidence —E. S. B. 4 
Eysenck, H. J. Maudsley Personality Inventory. Ado- 

lescent and adult. Test booklet (4 d); scoring 

keys (11 cach); manual, pp. 8 (2/6). London, 

England: University of London Press LTD, 1959. 


This brief questionnaire of 48 items and its even 
briefer short form (12 items) have played an in- 
tegral part in the author’s well known research on 
personality. Many instruments have been launched 
for full scale use with much less behind them. The 
manual represents the height of English diffidence. 
Only the briefest summary is given of a few of the 
salient results of research and the reader is referred 
to the relevant publications. He is told that “the 
M.P.I. should be regarded as a research instrument. 
Different firms, organizations, hospitals, universities, 
and other bodies have different problems, deal with 
different samples of the population, and aim at dif- 
ferent solutions of their problems. Only applied re- 
search can determine whether instruments such as 
the M.P.I. can be successfully used by them, and 
just what form such use can best take.” No high 
powered American merchandising here!—E. S, B. 


Technical Report on the California Test of Mental 
Maturity; pp. 32. Los Angeles: California Test 
Bureau, 1957. 


This report is intended as a comprehensive sum- 
mary of the development of the California Test of 
Mental Maturity in its various editions and short 
forms. It is designed to supplement the manuals for 
the six levels of the two series (short and long 
form). Extensive treatment is given to history and 
standardization. Validity data are confined to corre- 
lations with other pencil-and-paper intelligence tests. 
Contrary to discussions of construct validity in 
Technical Recommendations For Test Manuals, it is 
claimed that no other kinds of validating data are 
applicable —E. S. B. 


563 


„ame AED 
x “s, 


564 


c D. G. Manual 

drew, Dorothy M., & Patterson, al 

To o R E Clerical Test; Pp. 12. New York: 
Psychological Corporation, 1959. 


The previous revision of this well known test was 
issued in 1946. Approximately six new studies are 
reported; the results are much in the same pattern 
as earlier research. A much wider selection of norm 
groups is available in this manual—Z£. S. B. 


i w A now Y lj? 
kins, T. N. How Weil Do You Know Yourse 
ers NF-21) Adolescent and adult. Specimen 
Kit ($2:50 each) containing test booklet (with at- 
tached profile sheet), scoring keys, and a manual, 
pp. 26. New York: Executive Analysis Corpora- 

tion, 1959. 


This 120-item inventory yields 17 trait scores, e.g., 
Irritability, Novelty Loving, Vocational Assurance, 
Submissiveness, Impulsiveness, and two scores re- 
garding test taking attitudes, Consistency and Ob- 
jectivity. The trait scores are founded on factor 
analyses. Consistency is simply the tendency to give- 
the same answer to the same item at two different 
times. The test objectivity items are a refinement 
of a set empirically derived by differentiating two 
groups of subjects who, on the basis of interviews, 
were judged to differ in the realism of their concep- 
tions of themselves. The Seneral format of the test 
and manual leave something to be desired. The test 
booklet incorporates a profile and answer sheet and, 
thus, is expendable, which naturally increases the 
cost of using this instrument. The manual is writ- 
ten in a pedantic, Sometimes opaque style, 

This test may prove equal or superior to other 

ories, but the case is not proved 
marized in the manual. Although 
multiple correlations are reported 
f each factor with that factor, the 


satisfactorily high 
for the six items o 
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test-retest correlations, not unexpectedly, are me in 
too many instances. Norms for secondary “at 
college undergraduate, and office and factory ae 
lations of both sexes are based on small mips A 
defined samples. While there is evidence of co a 
able internal analysis of the test, external valid iy 
is limited to three studies, all doctoral ig 
one of which has been reported in the general li!2 
ture. Much more needs to be done.—E. S. B. 


. In- 
Strong, Jr., E. K. Manual for Strong Lime oie ga 
terest Blanks; pp. 40. Palo Alto, Calif.: Co: 
Psychologists Press, 1959, 


lace 

This is an expanded manual which takes the pia 
of separate manuals for the Men's and inven- 
forms of this most highly respected Erea aie is 
tory. More attention than in previous nEn “pyb- 
given to the interpretation of test scores. to. the 
lisher’s Foreword” rightfully calls attention h cane 
volumes of relevant research and writings me Is 
not be fully presented in a manual and repon Bin 
three additional books to “the serious studen 5 


À elor.” 
terest measurement and the professional counsi 
E. S. B. 


ERRATUM 


i 
The review of the Employee Aptitude pen 
the June issue of this Journal (p. 284) con daei 
misstatement that “In a few instances no offered- 
the correlations between alternate forms is Test 
One of these instances turned out to aA as 
which has no alternate form. This error ser to noti 
false support for a reading error in pce for! 
that the manual for Test 8 listed the alter man 
correlation in a context different from the 
for other tests in the battery. 


e 
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